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ABSTRACT 


Packet  Radio  is  a  digital  coaaunications  concept  which 
offers  the  user  the  capability  to  pass  voice  and  other  data 
traffic  in  a  radio  network  which  say  link  high  power 
coaputers  with  saall  aobile  radios  .  containing 
aicroprocessors.  The  technique  of  routing  digital  traffic 
from  source  to  destination  depends  on  the  operational 
requireaents  of  the  network.  host  routing  concepts  today 
centralize  network  control  ‘(in  varying  degrees)  for  noraal 
operations.  This  thesis  describes  a  concept  for  coapletaly 
decentralized  control  of  a  packet  radio  network.  The  basic 
protocol  is  relatively  siaple  and  robust,  but  suffers  froa 
the  usual  build-up  of  overhead  traffic  with  network  size. 
Another  related  routing  protocol  is  proposed  which,  under 
certain  operational  situations,  reduces  routing  traffic  and 
aeiory  requireaents  coapared  to  the  basic  algoritha.  A 
concept  for  use  cf  alternate  links  in  the  event  of  a  broken 
link  is  also  suggested. 
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A.  THE  PACKET  RADIO  CONCEPT 

Packet  Radio  technology  extends  the  application  of 
packet  switching  into  the  aobile  radio  environaent.  It 
offers  a  convenient  and  efficient  way  to  coaaunicate  aaong  a 
large  nuaber  of  aobile  users.  This  is  particularly 
iaportant  in  a  tactical  environaent  where  rapid  deployaent 
and  mobility  are  required. 

users  in  a  packet  radio  network  essentially  share  coaaon 
radio  channels.  Use  of  these  channels  is  (to  varying 
degrees)  controlled  by  Microprocessors  in  the  user's  radio 
in  a  aanner  which  is  transparent  to  the  user.  Packet  Radio 
is  a  digital  coaaunications  concept  which  in  principle  can 
accoaaodate  voice  as  well  as  digital  data  traffic  provided 
that  adequate  traffic  capacity  is  available.  The  use  in 
packet  radio  of  spread  spectrua  coaaunications  is 
particularly  attractive  to  Military  applications  because  of 
potential  capabilities  for  a  low  probability  of  intercept 
(IPX)  and  excellent  aatijaaaing  (AJ)  characteristics. 

Although  the  Military  is  pressing  developaent  in  packet 
radio  technology*  it  is  also*  in  a  sense*  part  of  the 
natural  evolution  of  the  coaputer  age.  Alaost  all  coaputer 
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networks  are  bound  to  the  cables  which  connect  the 
coaputers.  fet  as  coaputers  get  saaller  and  potentially 
more  aobile,  the  need  for  wireless  links  becoae  aore 
iaportant. 

Two  packet  radio  network  testbeds  are  currently  in 
operation*  The  flay  Area  PBHET  (packet  radio  network)  in  San 
Prancisco  has  been  operational  since  1976,  and  is  the 
priaary  site  for  developaent  and  evaluation  of  network 
protocols  and  application  concepts.  The  Aray  Data 
Distribution  systea  (ADDS)  testbed  pen EX  at  Ft.  Bragg,  north 
Carolina,  becaae  operational  in  1979  with  the  objectives  of 
providing  potential  users  of  packet  radio  technology  with 
exposure  to  the  technology  early  in  its  developaent,  giving 
tiaely  feedback  to  developers  and  offering  the  users  an 
opportunity  to  experiaentally  deteraine  the  impact  on 
tactical  doctrine  of  aobile  access  to  coapu ter- based  coaaand 
and  control. 

B,  BOOTING 

The  goal  of  a  properly  operating  packet  radio  network  is 
to  route  packets  (groups  of  bits)  thru  a  series  of  radios 
froe  the  sender  to  the  receiver  in  an  efficient  eanaer. 
Enroute,  the  packet  is  automatically  processed  and  passed  on 
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by  a  series  of  radios  in  a  aanner  transparent  to  those 
users.  Through  oultiplexing  or  other  concepts,  a  radio  aay 
provide  input/output  service  to  its  user  and  also  forward 
other  traffic  sisutaneously.  Because  of  the  limited  power 
of  aobile  radios,  a  transmitter  aay  often  not  have  a  direct 
link  with  the  ultimate  receiver,  in  a  military  application, 
low  power  transaissions  aay  also  enhance  survivability. 
Therefore  the  routing  fro a  every  potential  message  source  to 
every  potential  destination  requires  the  application  of  a 
network-wide  intelligence  to  determine  the  aost  efficient 
links  along  which  to  forward  the  message.  There  are  two 
aaln,  different  approaches  to  routing  algorithms  for  solving 
this  problem. 

i-  kattUailasi. a aLMfemimi 

Both  the  Say  Area  P3HET  and  the  Ft.  Bragg  PEiJET  use 
network  components  called  stations  to  manage  the  routing  in 
different  portions  of  the  network.  In  the  Ft.  Bragg 
network,  each  station  is  a  (DEC)  PEP  11/40.  The  purpose  of 
the  station  is  to  monitor  the  relative  activity  level  in 
each  radio  under  its  jurisdiction,  and  to  aid  in  the  routing 
of  traffic  that  passes  thru,  originates  or  terminates  in  its 
portion  of  the  network. 
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There  may  be  many  stations  in  a  network, 
controlling  a  certain  number  of  user  radios*  Together  they 
provide  the  network-wide  intelligence  which  maintains  and 
implements  the  dynamic  routing  scenario.  Network  control  is 
centralized  in  the  stations..  This  scheme  is  both  practical 
and  efficient.  However  in  a  ailitary  sense,  stations* are  a 
vulnerability  since  only  a  few  of  the®  control  the  operation 
of  all  the  radios  in  the  network. 

Use  of  a  backbone  network  offers  similar  advantages 
and  shortcomings.  &  backbone  is  a  network  superimposed  over 
a  common  user  network  which  improves  the  efficiency  of  the 
network  by  providing  high  volume,  high  speed  and/or  long 
distance  trunks.  Traffic  from  the  coaaon  user  is  placed  on 
and  taken  off  of  the  backbone  in  accordance  with  a  routing 
process  such  as  the  station  concept  mentioned  above.  Cnee 
again,  the  vulnerability  of  the  network  is  directly  related 
to  the  vulnerability  of  the  backbone. 

2.  .Ca.aPl9.t9.iy.. liege  atraliged.  Boutina 

A  completely  decentralized  network  does  not  have 
stations  or  a  backbone.  conceivably,  every  user  has  a 
packet  radio  containing  a  microprocessor  which  is  no 
different  than  any  other  communications/processing  component 
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(other  packet  radios)  in  the  net work,  Depending  on  the 
topographical  situation,  there  nay  also  be  unattended  packet 
radios  in  the  network.  These  radios  do  not  have  users  which 
use  the  radio  as  a  terainal  into  and  out  of  the  network. 
They  are  usually  placed  in  positions  in  the  network  to 
provide  additional  communication  paths  or  links  increasing 
the  number  of  routing  alternatives.  however  -  these 
unattended  radios  function  essentially  the  same  as  a 
terainal  user's  radio  insofar  as  message  processing  is 
concerned.  In  ether  words,  in  a  decentralized  network, 
every  radio  is  the  saae  and  there  is  no  centralized  or 
semi-centralized  component  controlling  how  the  network 
operates.  It  is  the  collection  of  packet  radios  theas elves 
which  must  coabine  their  processing  capabilities  to  create 
the  network-wide  intelligence  needed  to  build,  maintain  and 
implement  an  efficient  routing  scheme  for  user  traffic.  The 
advantage  is  a  reduction  in  the  vulnerabilities  inherent  in 
an y  system  which  tends  to  centralize  its  control 
capabilities.  The  disadvantages  are  increased  complexity, 
increased  overhead  traffic  (which  represents  competition 
with  user  traffic  for  a  finite  channel  capacity) ,  and 
possibly  a  reduction  in  speed. 
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Tbs  objective  of  this  study  is  to  present  and 
investigate  the  performance  of  a  siaple  algorithm  which 
could  be  programmed  into  each  packet  radio  in  a  completely 
decentralized  network.  Assuming  that  each  radio  in  the 
network  has  a  very  limited  range  compared  to  the  diameter  of 
the  network,  the  algorithm  allows  each  radio  to  relay 
information  about  other  radios  (called  nodes  from  now  on) 
throughout  the  network.  The  algorithm  uses  this 
information,  as  it  works  its  way  through  the  network,  to 
create  relatively  efficient  coma  unication  paths  (links) 
between  every  pair  of  radios  (nodes)  in  the  network.  The 
end  result  automatically  gives  users  throughout  the  network 
the  appearance  of  direct  access  to  every  other  node  in  the 
network,  albeit  with  some  delay.  The  dynamic  routing  of 
traffic  as  it  is  created  and  enters  the  network  enables  many 
channels  of  communications  to  exist  siautaaeously  across  the 


network 


II.  HETHQBK  aO-DELIHS 


Although  this  study  is  based  on  what  is  considered  a 
practical  concept  for  a  military  radio  network,  the  theory 
can  be  considered  very  general  in  nature.  Therefore,  the 
network  is  modeled  as  a  combination  of  nodes  and  links 
between  nodes.  Furthermore,  the  nodes  and  links  are 
affected  dynamically  by  events  such  as  routine  traffic,  the 
gain  or  loss  of  a  link,  and  network  maintenance  traffic. 
This  chapter  defines  the  modeling  components  and  functions, 
relates  them  to  physical  components  or  requirements,  and 
makes  some  assumptions. 

A.  MODES 

In  the  model,  nodes  represent  receiver- transmitters. 
Modes  also  contain  processors.  It  is  convenient  to  picture 
many  functions  in  each  node  performed  by  parallel  processors 
so  that  all  unrelated  processing  can  be  performed 
simutaneously.  Conversely,  only  those  operations  which  must 
be  performed  in  a  sequence  with  a  significant  execution  time 
are  subject  to  conflicts  and  queuing  delays. 

All  nodes  in  the  network  have  exactly  the  same 
capabilities.  However,  depending  on  its  processing 
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instructions,  each  node  a ay  process  a  given  message 
differently.  For  example,  one  node  aay  be  a  terminal  for  a 
specific  user.  Therefore,  this  node  aay  accept  routine 
traffic  for  a  certain  list  of  addresses,  deteraine  which 
traffic  is  addressed  to  its  assigned  user,  deliver  that 
traffic,  and  retransmit  the  remainder  to  the  appropriate 
addresses.  Another  node  aay  be  solely  a  transmitter  which 
only  relays  routine  traffic  and  does  not  serve  as  a  terminal 
for  a  user. 

when  one  node  can  pass  traffic  directly  to  another  node, 
the  other  node  is  considered  a  neighbor  to  the  first  node. 
These  nodes  are  connected  by  a  link.  Although  every  node  in 
our  network  can  contact  every  other  node,  each  node  has  only 
a  limited  list  of  neighbors  which  may  vary  with  time. 

3.  LX8KS 

A  link  exists  whenever  two  nodes  are  in  direct  contact 
with  each  other.  A  link  is  considered  broken  when  one  or 
both  nodes  lose  the  capability  to  transmit  to,  or  receive 
from,  the  other  node.  Therefore,  a  link  implies  two-way 
communications  between  specific  node  pairs.  Of  course  the 
actual  method  of  communications  in  a  radio  network  is 
through  antenna  transmissions.  These  aay  be  either 


directional  or  omni-directional  antennas.  And  of  course, 
these  transmissions  could  potentially  be  received  by  many 
nodes  other  than  a  particular  partner  in  a  node  pair* 
Conceptually,  this  can  be  accommodated  by  assuming  that  all 
traffic/packets  contain  the  address  of  the  intended 
receiving  node  for  a  given  link.  Then  any  node  which 
receives  traffic  not  addressed  to  it  simply  ignores  the 
message. 

Another  more  sophisticated  concept  has  a  link 
representing  a  unique  center  frequency  which  one  node  uses 
to  transmit  to  another.  In  creating  the  link,  the  two  nodes 
determine  which  frequency  bands  are  mutually  available,  and 
then  each  selects  an  available  transmission  frequency  to 
communicate  with  the  other  node.  Sow,  when  either  node 
wishes  to  transmit  to  the  other,  it  uses  its  selected 
frequency  band.  Conceptually,  only  one  node  within  range  of 
a  given  transmitter  will  accept  traffic  in  a  particular 
frequency  band.  in  this  manner  more  than  one  link  to  a 
single  node  may  be  operating  sisutaneously.  other  more 
familiar  techniques  such  as  Code  Division  tiultiplexing  could 
also  be  used  to  establish  a  link. 


C.  CHANNEL  7 ALOE 


Assuming  that  a  network  consisting  o£  many  links  has 
been  established,  one  needs  an  efficient  way  to  use  this 
network.  Clearly,  an  unacceptable  technique  would  be  to 
retransmit  every  message  on  every  link  to  ensure  that  the 
addressee  receives  the  message.  Although  it  may  ensure  that 
a  single  message  gets  to  its  destination,  it  represents  work 
for  every  node  in  the  network.  Assuming  that  different 
messages  could  be  initiated  by  many  nodes  in  the  network, 
and  that  much  of  this  traffic  could  be  present  in  the 
network  at  the  same  time.  The  inefficiencies  of 
broadcasting  quickly  lead  to  saturating  nodes  or  links  in 
the  network,  since  nodes  indiscriainantly  relay  everything 
they  hear.  Smart  nodes  should  be  able  to  do  much  better. 

What  is  needed  is  a  way  of  selecting  one  link  over 
another  link.  Once  that  decision  is  made,  traffic  for  a 
given  destination  uses  only  the  best  path,  or  optimum 
series  of  links,  from  the  source  of  a  message  to  its 
destination,  one  way  to  quantify  the  connection  between  two 
nodes  is  to  assign  a  weight  or  cost  value  to  each  link  or 
c*  '  \inel  in  the  network*  Then,  summing  the  costs  for  a  given 
path  between  two  nodes,  one  can  assign  a  value  to  every 


possible  path,  and  thereby  (theoretically)  pick  the  lowest 
cost  path  between  a  source  and  destination. 

there  aay  be  many  ways  to  assign  channel  values.  One 
practical  technigue  would  be  to  count  the  backlog  of  traffic 
(or  packets)  waiting  to  use  a  particular  link.  this  queue 
or  delay  represents  a  portion  of  the  total  tine  it  takes  for 
a  message  to  reach  its  destination.  normally  it  is  desired 
that  traffic  nove  through  the  network  as  quickly  as 
possible.  This  is  particularly  important  if  the  network  is 
to  accommodate  real-time  speech.  Therefore,  a  channel  value 
which  reflects  net  transmission  time  is  useful.  This  is  the 
technique  used  in  this  study, 

o.  network  om axes 

Modes  and  links  represent  the  static  network  structure. 
But  a  practical  network  must  accommodate  changes  which  say 
be  represented  as  the  creation  or  destruction  of  nodes  or 
links.  Furthermore,  there  must  be  a  concept  for  passing 
network  maintenance  information  and,  most  importantly,  user 
traffic. 

1.  Routine  or  Oser  Traffic 

A  network  exists  to  pass  routine  traffic*  Traffic 
could  be  either  inter-active  voice  (characterized  by 
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real-time  conversations) ,  or  data  (characterized  by  one-way 
transmissions  assembled  or  stored  at  the  receiving  end  for 
later  review) . 

In  a  digital  network,  both  voice  and  data  traffic 
are  transmitted  in  the  form  of  digital  packets.  For  voice 
traffic,  the  most  important  thing  is  that  packets  arrive  at 
a  relatively  uniform  rate.  Voice  packets  are  created  by 
sampling  the  voice  signal.  The  number  of  voice  bits 
required  per  unit  time  is  a  function  of  the  encoding 
technique  and  the  desired  quality  of  the  received  signal. 
Any  additional  bits  are  unnecessary  and  therefore  waste 
channel  capacity.  Fewer  bits,  in  the  form  of  delayed  or 
lost  voice  packets,  may  degrade  the  reception.  Mote  that 
once  a  voice  packet  is  delayed  one  inter-packet  period, it  is 
no  longer  useful. 

For  data  traffic,  it  is  not  necessary  to  have  a 
smooth  flow  of  traffic*  Bursty  traffic  is  quite  acceptable. 
The  important  thing  is  that  after  the  message  is  divided 
into  packets  for  transmission  from  the  source  node,  all 
these  packets  are  recovered  and  reassembled  properly  at  the 
destination  node  to  recreate  the  original  message. 
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The  ability  for  data  packets  to  move  satisfactorily 
in  a  bursty  aanner  allows  then  to  coapleaent  the  rigid 
schedule  of  voice  packets.  A  concept  for  the  integration  of 
voice  and  data  traffic  is  discussed  in  sore  detail  in 
Chapter  III. 

2. 

As  defined  earlier r  a  link  ia plies  the  capability 
for  two-way  cods unications  between  two  nodes.  A  broken  link 
is  recognized  in  a  node  when  it  is  discovered  that  this 
two-way  capability  no  longer  exists.  Depending  on  the 
situation,  as  explained  in  Chapter  XII,  the  two  nodes  on 
each  side  of  a  link  nay  realize  a  link  is  broken  at 
different  tines. 

In  nodeling  a  network,  a  broken  link  aay  be  used  to 
represent  various  events.  If  a  node  is  lost,  it  could  be 
reflected  as  a  broken  link  between  the  lost  node  and  each  of 
its  neighbors.  If  the  transnission  path  between  neighbors 
is  interrupted,  this  can  be  represented  as  a  loss  of  a 
single  link  between  the  two  nodes.  If  links  are  broken  in  a 
particular  pattern,  it  aay  indicate  that  a  particular  node 
is  noting  away  iron  its  neighbors. 


3.  Nett  Links 


As  opposed  to  a  broken,  link,  a  new  link  is  created 
when  the  nodes  on  each  end  establish  communication  with  each 
other.  This  will  typically  require  some  interaction  between 
the  two  nodes. 

New  links  would  be  created  when  an  inactive  node 
becoaes  active,  when  a  moving  node  noves  into  range  of  other 
nodes,  or  when  other  conditions  change  to  enable  two-way 
communications  between  two  nodes  where  conditions  previously 
prevented  this  link. 

It  is  apparent  that  a  network  can  be  dynaaically 
modeled  by  allowing  links  to  be  broken  or  created  to 
represent  physical  activities  such  as  changing  signal  paths, 
nodes  entering  and  leaving  the  network  (being  turned  on  or 
off) ,  node  movements  and  other  situations. 

<*•  isM&Ls 

If  the  nodes  in  a  network  are  to  be  as  organised  and 
resourceful  as  described  above,  then  they  must  be  programed 
to  coaaunicate  with  each  other,  passing  information  related 
to  their  activity  and  capabilities.  In  a  network  with  fully 
distributed  control,  the  objective  is  to  achieve  efficient 
network-wide  communication  under  the  constraint  that  each 
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node  can  only  transmit  and  receive  directly  with  a  limited 
number  of  neighbors.  There  is  no  central  control  facility 
to  route  and  monitor  traffic  between  non-ad jacent  nodes. 

Every  user  in  the  network  must  be  able  to  reach 
every  other  user  in  the  network  in  a  manner  which  is 
transparent  to  all  users,  even  in  a  dynamic  environment 
where  links  are  created  or  broken  randomly.  Therefore,  over 
and  above  user  traffic,  nodes  must  pass  network  maintenance 
traffic.  This  traffic  should  be  transparent  to  the  user. 
This  means  that  the  nodes  measure  or  sense  their  operational 
status  and  are  programmed  to  automatically  report 
information  to  their  neighbors.  Neighbors  process  the 
information  and  may  then  automatically  relay  the  processed 
Information  to  selected  neighbors  until  every  node  requiring 
the  information  eventually  receives  it.  4  program  or 
algorithm  that  generates  and  processes  network  maintenance 
traffic  is  commonly  called  a  protocol.  it  a  minimum,  to 
model  a  practical  network,  network  maintenance  traffic  must 
accommodate  new  links,  broken  links,  and  changes  in  channel 
values  which  may  represent  more  efficient  ways  of  routing 
routine  traffic  through  the  network.  The  concept  of 
protocols  for  distributed  networks  is  discussed  in  much 
greater  detail  in  Chapter  III. 
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A  distributed  protocol  ia  a  packet  radio  network  is  % 
defined  as  algorithms  which  are  executed  independently  in 
each  node  to  process  both  network  maintenance  and  routine 
traffic.  The  effect  should  be  the  overall  efficient  use  of 
network  resources,  approaching  the  efficiency  of  a  centrally 
controlled  network. 

A  particular  protocol  may  be  based  on  many  design 
considerations.  Of  course  the  designer  must  consider  the 
capabilities  of  available  or  proposed  equipment  and  the 
characteristics  of  the  operating  medium.  But  within  these 
constraints,  the  designer  may  be  free  to  trade  off  such 
things  as  simplicity  and  robustness  for  speed  and 
sophistication.  And  of  course  these  qualities  are  not 
mutually  exclusive.  Therefore,  the  examples  of  distributed 
protocols  in  the  literature  vary  from  rather  limited,  simple 
ones  such  as  ten's  algorithm  £&«£•  1jv  to  more 
sophisticated  and  complicated  algorithms  such  as 
Seg&ll'ts  £Ref.  2]. 

It  may  be  helpful  to  break  down  network  operations 
performed  by  each  node  into  three  groups  or  levels  of 
protocol.  in  this  way  activities  can  be  isolated. 
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controlled  and  analyzed  in  a  nodular  fashion  while  assuming 
the  reaainder  of  the  node's  functions  are  unaffected  and 
operating  as  expected.  This  study  assuaes  three  levels  of 
protocol.  The  first  is  node  to  node  protocol*  the  second  is 
network  aanageaent  protocol  and  the  third  is  user  service 
protocol.  Concepts  and  exanples  of  node  to  node  protocol 
and  user  service  protocol  are  discussed  in  soae  detail  in 
this  chapter.  network  aanageaent  protocol  is  aentioaed  only 
briefly  in  this  chapter,  Ho'iever,  a  detailed  concept  and 
example  is  developed  and  analyzed  in  the  reaainder  of  this 
study. 

a.  SODS  TO  SODS  PROTOCOL 

There  are  several  activities  required  in  an  active 
network  which  basically  involve  only  two  nodes.  Perhaps  the 
most  fuadaaental  interaction  is  recognising  each  other. 
This  autual  recognition  is  considered  a  link.  links  exist 
to  pass  traffic,  which  leads  to  another  laportant 
inter -nodal  function*  that  of  the  receiving  node  informing 
the  sending  nod©  that  it  has  received  its  aessage. 

'*  iad  aonitoring  a  Link 

k  nod©  to  node  protocol  should  provide  for 
establishing  coaaunicat ions  between  two  nodes.  Shis  could 
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be  accomplished  by  each  node  asynchronously  transmitting  a 
beacon  message  on  a  designated  frequency.  The  beacon 
aessage  would  contain  the  identity  of  its  originator.  Any 
other  node  receiving  the  beacon  aessage  with  an  adequate  S/N 
ratio  checks  its  list  of  neighbors.  If  the  node  addressed 
in  the  beacon  aessage  is  not  found  on  the  receiving  node's 
neighbor  list,  the  receiving  node  would  initiate  an 
acknowledgement  aessage  addressed  to  the  node  which  sent  the 
beacon  aessage.  If  the  original  node  now  receives  the 
acknowledgement,  it  adds  the  node  which  sent  the 
acknowledgement  aessage  to  its  neighbor  list  and  sends  that 
node  a  notice  aessage  that  two  way  communications  exist. 
Finally,  the  node  which  initially  responded  to  the  beacon 
aessage  adds  the  originator  of  the  beacon  aessageto  its 
neighbor  list  and  a  new  link  is  born. 

ks  mentioned  in  Chapter  II,  the  implementation  of  a 
link  may  vary  by  design.  If,  for  example,  the  two  way  link 
actually  consists  of  two  frequency  bands  which  enable 
simultaneous  transmission  between  two  nodes  on  a  single 
link,  then  the  interchange  of  information  in  establishing 
the  link  would  include  the  determination  of  mutually 
available  frequency  bands.  If,  on  the  other  hand,  the 


network  used  Carrier  Sense  Multiple  Access  (CSMA) ,  which  was 
the  technique  actually  used  in  the  DA&PA  packet  radio 
testbed  which  operated  in  the  San  Francisco  Bay 
area  £Hef.  3],  then  different  information  must  be  passed  to 
establish  a  link. 

Once  established,  the  status  of  a  link  must  be 
monitored.  The  beacon  message  could  also  be  used  for  this 
function.  A  node  should  expect  to  receive  beacon  messages 
from  every  node  on  its  neighbor  list.  Therefore,  when  it 
receives  the  beacon  message  there  is  no  need  to  reply. 
However,  it  may  note  the  time  it  received  the  last  beacon 
message  from  each  of  its  neighbors.  Failing  to  receive  a 
beacon  message  from  a  neighbor  over  an  established  period  of 
time  would  prompt  a  node  to  conclude  that  it  had  lost  two 
way  communications.  This  may  have  an  impact  on  many  other 
nodes  in  the  network  and  would  therefore  initiate  a  reaction 
by  the  network  management  protocol  as  discussed  in  paragraph 
2  below.  When  a  node  discovers  it  has  lost  a  link,  the 
corresponding  node  on  the  other  end  of  the  link  must  be 
removed  from  its  list  of  neighbors. 

There  is  another  more  immediate  way  for  a  node  to 
discover  that  it  has  lost  a  link.  This  would  occur  when  a 
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node  attempted  to  send  a  packet  to  a  neighboring  node  but 
does  not  receive  an  appropriate  acknowledgement  for  a 
successful  transmission.  If  this  is  the  case,  the  sending 
node  could  try  to  retransmit  at  least  one  more  time,  but 
eventually  it  may  conclude  that  the  link  has  been  broken. 
Once  again  this  may  initiate  activity  by  a  higher  level 
protocol.  This  also  demonstrates  how  one  node  may  discover 
that  a  link  has  been  broken  before  it  is  discovered  by  its 
corresponding  neighbor.  In  any  packet  radio  concept,  the 
establishment  and  monitoring  of  links  is  a  fundamental 
activity  that  can  be  delegated  to  a  low  level  protocol. 

2.  g.a.lg.4a.g..°faa^. 

Another  node  to  node  function  is  the  acknowledgement 
by  the  receiving  node  to  the  sending  node  that  a  packet  has 
been  successfully  transmitted  across  a  link.  Under  any 
practical  operating  concept  for  a  packet  radio  network, 
there  are  significant  opportunities  for  a  node  to  improperly 
receive  a  packet.  A  few  of  these  situations  include 
multipath  interference,  intentional  or  unintentional 
jamming,  fading  or  improper  synchronization.  A  conservative 
design  consideration  would  preclude  a  transmitting  node  from 
purging  a  transmitted  packet  from  its  memory  until  it  has 
received  acknowledgement  that  the  packet  has  been  received. 
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Ia  the  ALOHA  not,  operated  by  the  University  of 
Hawaii,  this  ac knowledge sent  is  accomplished  as  the  sending 
node  monitors  the  retransmission  of  the  receiving  node.  If 
the  retransmission  matches  what  was  sent,  the  sending  node 
eliminates  the  packet  from  its  memory.  If  it  did  not,  the 
packet  is  resent.  This  is  an  adeguate  technique  for  an 
ALOHA-type  network.  But  if  a  node  uses  different 
frequencies  for  each  link,  this  technique  may  be 
impractical. 

Another  concept  is  to  terminate  each  packet  with 
check  bits.  The  number  of  check  bits  per  packet  would  be  a 
function  of  the  expected  probability  of  error  per  bit  for  an 
average  link.  if  ail  check  bits  are  properly  received,  the 
receiving  node  reports  its  successful  reception  to  the 
sending  node  in  a  brief  message.  Lack  of  such  a  report 
after  an  established  period  of  time  may  prompt  a  node  to 
retransmit  a  packet.  Receipt  of  an  acknowledgement  would 
cause  a  node  to  eliminate  the  packet  from  its  memory, 
considering  it  successfully  transmitted.  There  are  check 
bit  schemes  for  fail-safe  communications  which  are  not  only 
more  efficient  than  a  bit-for-bit  check,  but  ace  also  more 
reliable  £Bef.  4]. 
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Other  verification  concepts  may  offer  still  other 
advantages.  However,  because  of  the  inherent  potential  and 
significant  effects  if  bit  error  in  radio  communications,  it 
is  very  likely  that  some  technique  of  ensuring  accurate 
packet  transmission  will  be  required  in  any  packet  radio 
network. 

B.  NETWORK  EANAGEEENI  PROTOCOL 

The  primary  objective  of  a  communications  network  is  to 
move  user  traffic  from  source  to  destination.  &  network 
management  protocol  is  intended  to  organize  the  network  so 
that  traffic  moves  efficiently  under  all  conditions. 

If  one  assumes  that  node  to  node  activities  are 
appropriately  handled  by  a  lower  level  protocol  as  described 
above,  then  he  can  treat  the  loss  or  addition  of  another 
link  as  a  routine  event,  and  process  the  information  as  it 
would  affect  the  entire  network.  Therefore,  network 
management  protocol  is  not  concerned  with  how  or  under  what 
conditions  a  link  is  established.  It  only  acts  on  the 
information  that  a  link  does  or  does  not  ekist. 

1.  BPdate 

The  fundamental  network-wide  management  operation  is 
the  update,  in  an  operational  network,  traffic  on  each  link 
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is  constantly  changing.  To  efficiently  use  the  network  to 
pass  traffic  between  two  given  nodes,  it  is  desirable  to 
find  the  "Best  Path"  between  the  two  nodes.  Exactly  what  is 
aeasured  may  be  a  subjective  decision.  But  once  aade,  this 
quantity  can  be  used  to  coapare  various  alternatives  and 
select  a  best  path.  Yet  the  best  path  can  be  expected  to 
vary  with  tine,  for  loading  on  each  link  of  a  network  nay  be 
constantly  changing.  Therefore  best  paths  must  be  updated 
periodically  to  accomodate  network  dynaaics. 

In  a  distributed  control  network,  each  node  could 
initiate  its  own  update.  The  fora  of  this  update  aessage 
and  exactly  how  it  is  processed  in  the  network  depends  on 
the  selected  protocol.  There  is  always  a  design  trade-off 
involving  the  frequency  of  updates  with  the  corresponding 
generation  of  update  aessages  (aaaageaent  traffic)  versus 
the  effects  of  old  or  outdated  best  paths.  This  tradeoff 
should  not  be  a  casual  decision.  In  a  network  of  n  nodes, 
there  are  at  least  n(n-1)  best  paths.  With  soae  of  the  aost 
efficient  algorithms,  it  nay  take  at  least  (n**3)  node  to 
node  aessages  to  complete  one  network-wide  update  under  the 
worst  conditions  (see  Appendix  C) •  Therfore  it  is  desirable 
to  find  an  effective  update  frequency  which  provides  for 
realistic  and  efficient  network  traffic  flow. 
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In  addition  to  updating  existing  paths,  the  updating 
process  can  serve  to  introduce  nev  links  into  the  network. 
In  some  protocols  such  as  Segall1 s  (Ref  2)  the  arrival  of  a 
nev  link  has  an  immediate  impact  on  the  network  update 
process.  &s  in  the  case  or  broken  links  discussed  next, 
Segall  immediately  initiates  a  new  update  message  whenever  a 
node  experiences  a  change  in  its  link  status.  This  creates 
a  situation  where  update  messages  initiated  by  the  same  node 
may  be  negotiating  the  network  at  the  same  time.  Therefore 
there  must  be  provisions  to  prioritize  these  messages  so 
that  the  most  recent  message  takes  precedence  over  the 
outdated  messages.  This  is  normally  accomplished  by 
introducing  cycle  numbers  as  part  of  each  update  message  and 
many  other  network  management  messages.  The  problem  with 
cycle  numbers  is  that  they  can  potentially  grow  larger  than 
the  allotted  buffer  space.  Segall  places  a  bound  on  his 
cycle  numbers  by  using  a  procedure  devised  by  Finn  £Re£.  SJ. 

One  of  the  objectives  of  this  study  is  to 
investigate  a  network  management  protocol  that  does  not 
require  cycle  numbers.  in  this  concept  new  links  are 
introduced  to  the  network  only  during  routine  updates*  It 
is  assumed  that  the  delay  involved  may  be  traded  for 
iacremeed  simplicity. 
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2.  Link  Breakdown 


Broken  links  nay  have  various  impacts  on  a  network. 
If  a  link  is  under  heavy  use,  a  break  may  have  a  serious 
effect  on  net  traffic  flow.  Heavy  use  may  also  indicate 
that  many  other  nodes  rely  on  this  particular  link  in  their 
best  paths  to  other  distant  nodes.  On  the  other  hand*  some 
links  may  serve  very  few  nodes,  and  in  fact  be  inactive  at 
the  time  a  break  is  discovered. 

The  objective  of  any  reaction  to  a  broken  link  is  to 
minimize  its  impact  on  the  flow  of  traffic  and  other  network 
activity.  Ideally,  traffic  should  immediately  and 
automatically  be  switched  to  the  next  best  path.  One  way  to 
incorporate  alternate  links  under  certain  circumstances  is 
described  in  Appendix  A  and  is  considered  along  with  the 
proposed  network  management  protocol  in  chapter  IV. 

Uhen  it  cannot  always  immediately  reroute  traffic, 
the  network  management  protocol  must  take  action  to  stop  or 
reduce  traffic  intended  for  a  broken  link,  cause  the  network 
to  find  new  best  paths  for  traffic  affected  by  the  break,  or 
a  combination  of  both.  Finding  new  best  paths  is  typically 
done  during  an  update  operation.  It  is  a  function  of  a 
protocol  to  indicate  how  an  update  may  be  initiated. 
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In  some  protocols  discovery  of  a  break  may  initiate 
an  update.  For  example,  the  discovering  node  may  broadcast 
a  special  update  request  message  addressed  to  each 
destination  for  which  the  discovering  node  had  considered 
the  broken  link  as  part  of  a  best  path.  other  nodes  echo 
the  request  and  eventually  the  destination  nodes  receive 
their  requests  and  initiate  an  update.  in  this  concept, 
some  type  of  cycle  number  would  be  required  to  mediate 
conflicts  between  new  and  outdated  updates  from  a  single 
destination  node  which  could  exist  in  the  network  at  the 
same  time, 

alternatively,  a  protocol  can  be  designed  to 
routinely  issue  updates  from  each  node  at  a  rate  that 
ensures  that  any  previously  issued  update  message  from  a 
particular  node  had  already  passed  out  of  the  network,  yet 
often  enough  to  tolerate  freezing  traffic  blocked  by  a 
broken  link  until  the  next  routine  update  provides  a  new 
best  path.  This  is  the  basis  of  the  network  management 
protocol  proposed  in  chapter  XV. 

C.  USES  SEHVICS  PSOIOCOL 

Once  a  network  is  constructed  and  operational,  the  last 
question  is  how  routine  user  traffic  will  be  packaged  and 
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processed  by  each  node  in  the  network.  This  could  be 
considered  the  Oser  service  Protocol  level.  In  this  case 
the  designer  say  assume  that  lower  level  protocols  will  work 
independently  to  do  things  such  as  update  best  paths,  react 
to  new  or  broken  links,  and  acknowledge  transaissions  across 
a  link.  The  User  Service  Protocol  uses  selected  information 
from  lower-level  protocols  to  efficiently  accoaplish  its 
priaary  function  of  passing  user  traffic. 

The  basic  characteristic  of  a  user  service  protocol  in  a 
packet  radio  network  is  that,  like  other  lower  level 
protocols,  it  should  be  transparent  to  the  user.  Decisions 
such  as  packet  size,  content,  and  processing  depend  on  the 
capabilities  of  the  selected  equipaeat  and  the  priorities  of 
the  network  designer.  In  this  section  a  particular 
algor it ha  is  discussed  as  an  example  of  a  typical  user 
service  protocol.  It  is  presented  to  illustrate  one 
possible  technique  for  managing  routine  traffic  within  the 
fraaework  of  a  network  operating  with  other  lower  level 
protocols * 


Several  assumptions  east  be  sade  in  order  to  gain 
physical  appreciation  of  the  requirements  of  a  conceivable 


packet  radio  network.  some  of  the  parameters  selected  both 
here  and  in  the  remainder  of  this  study  are  based  on  a 
theoretical  packet  radio  concept  proposed  for  a  Marine 
Amphibious  Brigade  by  Bond  (Ref.  6],  and  Lucke  [Ref.  7]. 

It  is  assumed  that  the  network  will  move  both  voice 
and  data  traffic.  In  this  section  we  discuss  the 
characteristics  and  requirements  of  each  type  of  traffic. 
As  mentioned  in  Chapter  II ,  voice  oust  flow  at  a  consistent# 
periodic  rate.  Data#  on  the  other  hand,  can  move  in  bursts 
as  channel  capacity  becomes  available. 

In  a  digital  network,  voice  must  be  converted  to  a 
digital  signal  (vocoding) .  This  is  >.  done  by  sampling  the 
analog  voice  signal  and  converting  each  sample  to  a  digital 
value.  This  produces  a  voice  packet.  In  a  real-time 
conversation,  any  delay  of  more  than  approximately  0. 1  sec 
between  speakers  becomes  noticeable.  Therefore  a  voice 
packet  should  take  no  more  than  0.1  see  to  move  from  the 
source  node  to  the  destination  node.  Assuming  that  packets 
will  be  relayed  by  a  maximum  of  10  nodes  in  our  theoretical 
network,  and  further  assuming  that  processing  time  in  each 
node  is  far  more  significant  than  the  propagation  time 
between  nodes,  then  the  maximum  processing  delay  per  node  is 
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.  1  sec 

Delay  =  ■•■■■ . -  =  .01  sec/node/packet. 

10  nodes 

Because  of  the  periodicity  requireaents  of  voice, 
there  are  certain  advantages  to  establishing  a  virtual  link 
between  the  traffic  source  and  destination.  In  a  packet 
radio  network,  a  virtual  link  nay  consist  of  reserving  a 
tine  slot  on  each  link  along  the  best  path  from  the  source 
to  destination  at  the  tine  the  virtual  link  is  established. 
Once  a  virtual  link  is  established,  it  is  used  until  the 
source  node  has  finished  the  voice  conversation  (unless  a 
link  is  broken) ,  regardless  of  whether  or  not  subsequent 
update  operations  have  found  other  best  paths  during  the 
course  of  the  conversation.  This  ensures  periodicity  in  the 
voice  traffic,  for  each  voice  packet  passes  thru  the  sane 
number  of  nodes,  with  the  saae  net  processing  tine  for  a 
given  source-destination  pair. 

In  a  practical  network,  a  link  would  probably  be 
required  to  accoaaodate  traffic  for  acre  than  one  node  at  a 
time.  &s  iaplied  in  the  previous  paragraph,  this  nay  be 
accoaplished  by  transacting  traffic  for  a  specific 
destination  node  in  an  assigned  tiae  slot  on  each  link, 
this  is  also  called  tiae  division  aul tipi wring.  the 
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particular  slot  on  each  link  enroute  to  a  destination  is 
determined  as  the  call  is  being  initiated  and  the  virtual 
link  is  being  built.  Once  established,  this  slot  will  only 
carry  voice  packets  for  its  assigned  destination  until  the 
virtual  link  is  broken  or  disaantled. 

It  is  convenient  to  define  the  series  of  tiae  slots 
which  can  each  carry  a  separate  virtual  link  as  a  Fraae. 
Then  in  each  fraae,  one  slot  represents  one  virtual  link  to 
a  destination.  During  nor sal  link  operation,  each  fraae  is 
followed  by  another  fraae  carrying  the  next  voice  packet  in 
the  assigned  slot  for  each  virtual  link  (see  Fig.  3. 1), 


-L 


fraae 


sequence  of  slots 


fraae  fraae  fraae 


sequence 

or 

fraaes 


Fig.  3.1.  slot/Fraae  Concept 


It  was  estreated  above  that  if  a  aaxiaus  of  10  nodes 
were  used  in  a  virtual  link,  each  node  can  take  up  to  .01 
sec  to  retransmit  one  voice  packet.  if  it  is  further 
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assumed  that  each  frame  must  handle  up  to  10  virtual  links 
(slots) ,  then  each  slot  (which  carries  one  voice  packet)  can 
be  no  aore  than  1  asec  because  each  frame  can  last  no  nore 
than  .01  sec. 

.01  sec/fraae 

Slot  Duration  *  —  — — — — —  s  1  msec/slot. 

10  slots/fraae 

It  is  estiaated  that  good  quality  digital  adaptive 
Delta-aod  voice  requires  a  bit  rate  of  16  x  (10**3) 
bits/ sec.  Xn  the  multiplexing  system  mentioned  above*  each 
voice  channel  has  only  a  1/IOth  duty  cycle.  Therefore  when 
active,  a  virtual  link  aust  pass  traffic  at  a  rate  of  160  x 
(1Q*m3)  bits/sec. 

For  this  example,  if  the  radios  in  this  network 
operate  with  a  bandwidth  of  approximately  lOOBHz  (spread 
spectrum),  a  significant  pqst  detection  processing  gain 
could  be  obtained 

Transmission  Bandwidth  1Q*»8 

Bandwidth  of  Message  160  x  (10**3) 

=  625  •  28  dB. 
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2.  Data. Traffic 


Data  traffic  would  not  normally  have  the  stringent 
timing  requirements  that  voice  traffic  may  require.  On  the 
other  hand,  within  reason,  voice  traffic  could  afford  to 
randomly  lose  packets  while  experiencing  a  graceful 
degradation  in  the  actual,  flow  of  information,  whereas  any 
lost  data  packets  represent  an  absolute  loss  of  information. 
Therefore  the  network  may  pass  data  traffic  more  slowly,  but 
must  do  so  more  accurately. 

Because  of  the  periodicity  requirement  of  voice 
traffic,  vcice  packets  need  to  have  priority  over  data 
packets.  under  this  network  concept,  data  traffic  would  be 
integrated  as  a  filler  in  available  slots  during  pauses  in 
voice  traffic.  The  result  is  bursts  of  data  traffic,  which 
does  not  lend  itself  to  the  virtual  link  concept  described 
for  voice  traffic.  in  fact  it  may  be  simpler  to  picture 
each  data  packet  as  an  individual  message  containing  the 
address  of  the  destination,  and  being  released  by  the  source 
node  to  find  its  way  to  the  destination  node.  One  advantage 
of  this  concept  is  that  i*  the  network  updates  its  best 
paths  while  a  source  node  is  releasing  data  packets  for  a 
particular  destination,  later  packets  have  the  advantage  of 


using  the  updated  best  paths  to  their  destination.  By 
contrast,  in  the  virtual  link  concept  considered  here,,  once 
a  virtual  link  is  established,  traffic  is  confined  to  it 
even  though  better  paths  may  become  available. 

If  data  traffic  is  to  be  moved  on  the  network 
developed  earlier,  it  must  be  able  to  work  within  the 
frame/slot  concept  devised  for  voice  traffic.  Assuming  a 
slot  has  a  duration  of  1  msec  with  a  data  rate  of  160  x 
(10**3)  'bits/sec,  then  each  slot  contains  approximately  160 
bits  of  information.  In  the  virtual  link  concept  this  may 
be  perfectly  acceptable  because  once  the  virtual  link  is 
established,  nearly  all  bits  passed  on  the  virtual  link  are 
user  traffic.  However,  if  each  data  packet  is  to  move 
independently  from  the  source  node  to  the  destination  node, 
each  packet  must  contain  certain  overhead  information  which 
is  commonly  lumped  together  at  the  beginning  of  the  packet 
in  a  preamble. 


Pig.  3.2.  Preamble 


The  preamble  in  Fig.  3.2  illustrates  some  of  the 
information  that  might  be  required  in  the  heading  of  a  data 
packet.  If  this  information  were  to  require  a  portion  of 
the  available  bits  in  every  slot,  it  would  seriously  degrade 
the  rate  at  which  user  data  could  be  passed.  An  alternative 
is  to  use  much  larger  data  packets. 

Oata  packets  are  typically  created  as  the  source 
node  divides  up  a  stream  of  data  from  a  buffer  which  is 
being  fed  by  a  console,  facsimile  device,  etc.  The  size  of 
the  packets  is  dictated  by  the  user  service  protocol. 
Therefore  the  number  of  data  packets  needed  to  carry  the 
users  entire  message  is  obviously  a  function  of  -the.  messages 
size  and  the  size  of  a  data  packet.  On  the  receiving  end, 
not  only  must  all  data  packets  be  received  (correctly) ,  but 
it  may  be  required  to  sort  the  packets  to  place  them  in  the 
proper  order,  meaning  each  packet  must  be  serial  numbered. 
Information  such  as  this  does  not  contribute  to  the  net  flow 
of  user  information.  Therefore  to  pass  the  largest  possible 
ratio  of  user  information  to  preamble  information  with  the 
slot  technique#  a  data  packet  including  preamble  should  be 
some  larger  multiple  of  a  voice  packet. 
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When  data  packets 

are  transmitted  across 

a  link 

,  the 

sending 

node  reads  the 

preamble  of 

the 

data 

packet 

and 

assigns 

a  slot  number  on  the  best 

path 

link 

toward 

the 

destination  node.  The 

sending  node 

then 

divides  the 

data 

packet  into  sub-packets  which  are  the  size  of  a  slot. 
Depending  on  the  standard  size  of  a  data  packet,  the  sending 
node  sends  the  remainder  of  the  data  packet  in  the 
appropriate  slot  in  consecutive  frames.  The  receiving  node 
is  also  programed  to  accept  a  standard  number  of 
sub-pacKets  once  it  has  agreed  to  accept  a  data  packet  in  a 
particular  slot.  In  this  way  only  one  preamble  is  sent  per 
data  packet  and  the  effective  ratio  of  user  information 
actually  passed  could  be  significantly  increased. 

This  procedure  is  essentially  another  version  of  the 
virtual  link.  Depending  on  the  number  of  sub-packets  and 
system  priorities  for  handling  sub-packets,  a  virtual  link 
for  a  data  packet  aay  vary  in  size.  For  example,  if  nodes 
are  progressed  to  relay  sub-packets  as  soon  as  they  are 
successfully  received,  several  nodes  on  the  best  path  aay  be 
relaying  portions  of  a  single  data  packet  at  the  same  time. 
Xn  fact,  the  destination  node  aay  be  receiving  the  first 
subpackets  before  the  last  subpackets  are  transmitted.  The 
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difference  is  that  these  virtual  links  have  a  fired  finite 


lifespan.  They  are  limited  by  the  aaount  of  time  the 
designer  wants  to  sake  a  slot  unavailable  to  voice  traffic. 
An  extension  of  the  saae  idea  has  two  or  aore  slots  in  the 
saae  fraae  being  used  to  pass  sub- packets  of  the  saae  data 
packet.  This  provides  a  aore  efficient  use  of  a  link  which 
aay  have  little  voice  traffic  and  is  consistent  with  the 
bursty  nature  of  traffic. 

3.  integrated  Ma na oe aent  Traffic 

With  the  exception  of  the  preamble,  there  has  been 
no  aention  of  aanageaent  traffic  which  is  required  by  node 
to  node  and  network  aanageaent  protocols.  Typically  this 
traffic  consists  of  relatively  short  aessages.  it  is 
conceivable  that  these  aessages  could  be  tagged  on  the  end 
of  user  packets  placed  in  each  slot.  in  this  situation  it 
would  appear  to  the  network  that  100  percent  of  channel 
capacity  was  available  to  user  traffic.  If  this  is  not 
practical,  then  slots  could  be  used  on  an  as-needed  basis  to 
pass  groups  of  aanageaent  aessages. 

There  is  another  aspect  of  traffic  aanageaent  that 
nay  be  considered.  Once  voice  traffic  is  interrupted,  it  is 
iaportant  that  the  speaker  be  notified.  This  could  be  a 
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programmed  response  to  the  network's  reaction  to  a  broken 
link.  The  result  would  be  for  the  speaker  to  quit  talking. 

Similarly,  for  data  traffic  it  is  practical  for  the 
source  node  to  release  only  a  limited  number  of  data  packets 
into  the  network  and  wait  for  a  receipt  acknowledgement  from 
the  destination  node  as  data  packets  arrive.  This  is  called 
"flow  control".  This  prevents  a  source  node  from  loading 
interim  nodes  with  excessive  traffic  which  the  network  may 
not  be  able  to  process  because  of  a  lost  link  to  the 
destination.  It  also  allows  the  source  node  to  selectively 
retransmit  packets  that  were  not  successfully  received  and 
erase  those  that  were.  Finally#  it  provides  assurance  that 
the  data  traffic  was  received. 
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xv.  A_D-IS.TRIBOT.ED  NETWORK  MANAGEMENT  PROTOCOL  CONCEPT 


This  chapter  describes  a  particular  concept  for  a 
distributed  control  network  aanageaent  protocol.  This 
protocol  is  liaited  by  design  to  fit  into  the  larger  concept 
of  independent  levels  of  protocol  which  handle  different 
classes  of  messages,  processed  as  described  in  Chapter  III. 
Analysis  of  the  protocol  developed  here  by  a  coaputer 
siaulation  is  discussed  in  Chapter  V. 

A.  SETTING  THE  FBAMEHORK 

The  following  network  aanageaent  protocol  is  based  on 
the  assuaption  that  an  adeguate  node  to  node  protocol  is 
perforaing  necessary  functions  such  as  periodically  testing 
links,  discovering  new  as  well  as  broken  links,  and 
confiraing  when  a  packet  has  been  successfully  traasaitted 
across  a  link. 

It  is  further  assuaed  that  the  result  of  this  protocol, 
which  is  intended  to  be  a  flexible  network  which  can  react 
to  link  changes  and  find  new  best  paths  based  on  the  latest 
channel  values,  will  be  used  by  a  higher  level  user  service 
protocol.  This  higher  protocol  could  reseable  that 
described  in  chapter  III.  But  it  is  not  necessary  to  define 
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a  particular  user  service  protocol  in  order  to  investigate  a 
lower  level  network  management  protocol.  Therefore  the 
reaainder  of  this  stud;  will  minimize  any  assumptions  about 
the  form  of  higher  level  protocols  which  may  use  the  results 
of  this  network  management  protocol. 

3.  DEFINITIONS 

All  the  moot  common  components  of  our  network,  such  as 
nodes  and  links,  have  already  been  mentioned.  However  it  is 
necessary  here  to  further  describe  certain  previously 
defined  components,  and  to  present  additional  components  or 
concepts  needed  to  explain  the  protocol. 

i*  £h&Jaal£L£saaB 

The  Basic  Group  is  what  has  been  defined  as  the 
network  up  to  this  point.  A  basic  group  is  a  collection  of 
nodes,  each  having  a  unigue  identification,  each  being 
connected  to  at  least  one  other  node  in  the  basic  group,  and 
each  node  being  considered  an  egual  member  of  the  group  (See 
Fig.  4.1).  By  using  only  links  belonging  to  the  basic 
group,  it  is  possible  to  send  a  message  from  any  node  in  the 
basic  group  (called  the  Source)  to  any  other  node  (called 
the  Destination) • 
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Pig.  4.1.  Exaaple  of  a  Basic  Group 


Our  network  aanagenent  protocol  will  initially  be 
developed  with  nothing  aore  than  a  basic  group.  Later,  a 
version  of  the  protocol  involving  "Belated  Groups"  and 
"Faailias  of  Groups"  will  be  introduced.  However  this  will 
have  little  iapact  on  the  basic  concept. 

In  order  to  sove  user  traffic  efficiently,  the 
protocol  aust  be  able  to  calculate  the  best  route  froa  a 
source  to  destination  node.  To  do  this,  each  link  is 
assigned  a  channel  value,  and  these  values  are  suaaed  and 
coapared  to  deteraine  the  best  path  froa  the  source  to 
destination  node.  It  is  not  essential  to  specify  in  advance 
the  exact  physical  nature  of  these  channel  values,  or 


distances  as  they  are  sonatinas  called.  But  whatever 
charnel  value  physically  amounts  to,  it  should  reflect  the 
relative  "cost"  of  sending  traffic  over  a  link  at  the  tiae 
it  is  aeasured. 

k  best  path  iaplies  that,  based  on  existing  links 
and  current  channel  values  at  the  tiae  it  was  aeasured, 
there  is  at  least  one  coa bination  of  links  whose  net  channel 
value  represents  the  aost  efficient  path  froa  the  source  to 
destination.  This  is  frequently  considered  the  niniaua 
delay  route.  Best  paths  can  becoae  outdated  for  two 
reasons:  either  one  of  its  links  is  broken  making  aoveaent 
inpossible,  or  another  combination  of  links  develops  a  lower 
net  channel  value. 

It  should  be  noted  that  each  link  is  a  two  way 
connunications  channel,  and  usually  the  current  channel 
value  in  one  direction  has  no  relationship  to  the  channel 
value  in  the  other  direction.  In  Fig.  4.2  below,  the 
channel  value  froa  nodes  A  to  3  is  1.  However  the  channel 
value  froa  nodes  B  to  A  is  5.  This  aeans  that  for  any  two 
nodes  in  a  basic  group,  the  best  path  froa  the  first  node  to 
the  second  is  not  necessarily  the  best  path  froa  the  second 
node  to  the  first.  Thus  in  any  basic  group  of  H  nodes, 
there  are  H(H-i)  or  approxiaately  H**2  possible  best  paths. 


u 
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Fig.  4.2.  Channel  Values  on  a  Two-way  Link 

2.  Activities 

in  the  course  of  maintaining  the  network,  the 
protocol  will  cause  each  node  to  initiate  and  participate  in 
several  management  activities.  host  have  already  been 
mentioned  and  will  only  be  discussed  briefly  here. 

The  best  path  update  is  the  fundamental  operation  of 
this  level  of  protocol.  As  channel  values  change  and  best 
paths  become  outdated,  steps  must  be  taken  to  find  the  new 
best  path.  This  process  is  automatically  and  asynchronously 
initiated  by  each  node,  and  when  it  is  completed  (which  may 
require  the  origination  of  several  update  cycles  as 
discussed  below) ,  every  other  node  in  the  basic  group  knows 
the  latest  best  path  to  the  initiating  node.  This  operation 
is  periodically  required  of  eyery  node  in  the  network.  The 


reason  why  complete  updating  of  the  best  paths  may  require 
sore  than  one  initiation  or  an  update  cycle  can  be  seen  in  a 
simple  example.  in  the  network  in  Fig.  4.3,  node  A  sends 
out  an  update  message  to  nodes  3  and  C.  Node  C  updates  its 
channel  value  to  A  from  5  to  4  but  still  retains  its  old 
best  path  thru  node  B  believing  it  has  a  total  channel  value 
of  3.  Finally  after  node  B  relays  A's  update  message  to  C, 
node  c  learns  that  the  actual  channel  value  thru  node  B  to  A 
is  now  7.  » hen  A  initiates  its  next  update,  node  C  will 
change  its  best  path  to  node  A  to  be  the  direct  A-C  link. 


^Channel  values, as  of  last 
update 

.•''  Channel  values  now 


Update  iterations 


A  broken  link  can  be  a  traumatic  event  in  the 
network.  therefore  the  protocol  will  react  to  broken  links 
in  an  attempt  to  minimise  the  effect  on  user  traffic  flow. 
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First  it  will  attempt  to  switch  all  traffic  hampered  by  the 
broken  link  to  an  alternate  link.  An  alternate  link  is 
defined  only  in  respect  to  individual  nodes,  and  if  one  is 
av^iiuble,  it  may  be  used  by  a  node  if  the  node  is  faced 
with  an  inability  to  move  traffic  over  a  previous  best  path 
which  now  contains  a  broken  link.  ha  alternate  link  can 
only  be  considered  as  a  temporary  fix.  its  only  guarantee 
is  that  if  used,  it  will  not  create  a  loop  situation.  A 
loop  is  defined  as  a  closed  path  consisting  of  a  series  of 
links.  Therefore  traffic  leaving  a  loop  node  will 
eventually  return  to  that  node.  In  Fig.  4.4,  node  2  cannot 
consider  the  link  to  node  .4  as  an  alternate  link  if  node  4 
routes  traffic  destined  for  node  1  through  node  3.  This 
creates  a  loop.  However  if  node  2  can  be  assured  that  node 
4  will  not  route  traffic  destined  for  node  1  on  any  path 
which  eventually  moves  through  node  2,  then  node  2  can 
switch  traffic  to  node  4  after  a  break  with  confidence  that 
it  retains  a  loop-free  network. 

Although  switching  traffic  of  a  best  path  implies  a 
decrease  in  efficiency,  the  alternate  may  be  to  stop  all 
traffic  routed  over  a  broken  link.  of  course  this  may  be 
even  less  efficient.  But  a  node  faced  with  the  decision  may 


52 


Best  Path  Link 


Before  Break 


After  Break 


Fig.  4.4.  Loop 

not  always*  have  the  option  of  an  alternate  link*  See 
paragraph  C3  below  and  Append!*  k  for  a  discussion  and  proof 
of  an  alternate  link  concept  which  is  compatible  with  the 
network  aanageaent  protocol  described  in  this  chapter. 

Clearly*  it  is  required  that  a  node  be  able  to  cope 
with  a  situation  where  it  nay  lose  all  access  to  one  or  store 
nodes.  Recovery  is  defined  as  eventually  establishing 
another  path  to  the  disconnected  nodes.  She  efficiency  of 


53 


recover?  is  defined  as  the  speed  at  which  a  path  is 
reestablished  over  the  new  best  path. 

To  accomplish  the  above  activities,  each  node  in  the 
network  will  create,  process  and  relay  messages  froa  other 
nodes.  The  processing  will  frequently  change  components  of 
a  message  that  a  node  receives  froa  a  previous  node,  adding 
information  to  the  aessage  before  relaying  it.  Nodes  are 
also  selective  as  to  which  other  nodes  it  will  send  or  relay 
a  aessage.  The  net  result  is  to  improve  network-wide 
operation  and  efficiency. 

s 

3.  Messages 

The  network  management  protocol  is  required  to  send 
two  types  of  overhead  messages  related  to  the  maintenance 
activities  mentioned  in  the  previous  paragraph.  Each 

aessage  will  have  several  elements  which  will  he  abbreviated 
and  represented  in  a  message  argument. 

a.  Update  Hess  age 

The  symbol  for  an  update  aessage  and  its 
components  are  shown  below.  The  letter  1  identifies  the 
last  node  to  relay  the  update  message  (or  U-msgi .  The 
letter  d  identifies  the  originator  of  the  U-asg.  Note  that 
when  the  originator  first  sends  the  U-asg,  l»d.  D(l)  is  the 
cuaaulative  channel  value  on  the  best  path  froa  1  to  d. 


Update  Message  ==>  U(l,d,D(l)) 


b.  Broken  Path  Message 

The  syaboi  for  a  broken  path  sassage  and  its 
components  are  shown  below.  She  argusent  d  represents  the 
destination  node  for  which  the  broken  link  is  blocking 
traffic,  and  corresponds  to  the  d  in  the  U-asg.  The  d  in 
the  U-asg  is  the  identity  of  the  initiating  node,  and 
represents  the  destination  to  which  the  best  paths  created 
by  this  U-asg  will  point.  She  d  in  the  X-msg  indicates  that 
the  best  path  to  d  is  broken. 

Broken  Path  Message  »*>  X(d) 

C.  THE  CONCEPT 

The  objective  of  this  network  management  protocol  is  to 
provide  a  single  algoritha  that  can  operate  autonomously  in 
each  node  of  a  network  to  ^ovide  completely  decentralised 
network  control,  yet  provide  for  efficient  traffic  routing. 
This  algoritha  was  also  chosen  for  its  relative  simplicity 
and  potential  robustness.  Its  priaary  departure  from  aost 
other  algcrithas  of  this  nature  is  that  it  attempts  to 
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accommodate  new  and  broken  link  events  without  requiring 
cycle  numbers.  The  algorithm  is  given  in  Appendix  B. 

1.  Normal  Operations  without  New  or  Broken  Links 

It  is  aost  convenient  initially  to  study  the  update 
process  while  freezing  the  status  of  nodes  and  links.  Be 
will  also  initially  assume  each  node  has  a  best  path  to 
every  other  node.  As  aentioned  earlier,  the  basic  group  or 
network  consist  of  N  nodes.  The  number  of  links  between 
these  nodes  will  noraally  exceed  the  number  of  nodes. 
Normally,  if  they  are  evenly  distributed,  the  more  liuks 
into  an  average  node,  the  more  robust  is  the  network. 

To  efficiently  use  a  network,  traffic  should  take 
the  best  path  from  the  source  to  destination  node.  To 
identify  and  use  this  path,  each  node  along  the  way  must 
know  the  destination  of  the  traffic,  and  what  neighboring 
node  is  downstream  on  the  best  path  to  each  destination. 
Downstream  will  imply  movement  toward  the  destination,  that 
is,  relaying  the  traffic  to  another  nod*  with  a  smaller 
cuaaulative  channel  value  to  the  destination.  Upstream 
implies  movement  away  from  the  destination,  normally 
backwards  along  the  best  path.  The  update  message  allows 
each  node  to  determine  which  neighbor  is  on  Its  best  path  to 


every  other  node  in  the  network.  Each  node  periodically 
initiates  a  O-asg  to  all  its  neighbors,  in  Fig.  4.5  node  1 


Fig.  4.S.  initiating  an  Update 

initiates  an  update  by  sending  0(1, 1,0)  to  nodes  2  and  4. 
When  a  node  receives  a  0-asg  ititiated  by  d,  it  computes  the 
cuamulative  channel  value  to  i  thru  1  and  compares  it  to  the 
last  cuBoulative  channel  value  along  the  node*s  current  test 
path  to  d.  For  example,  in  Fig.  4.5,  suppose  node  4  had 
previously  selected  the  direct  link,  with  channel  value  «  S» 
as  its  best  path  to  node  1.  Meanwhile  node  2  has  also 
received  a  0-*msg  from  node  1,  has  determined  that  this  is 
its  best  path  to  node  1  because  no  other  path  offers  a 


cuaaulative  channel  value  of  1,  and  has  relayed  node  I's 
U-asg.  Node  2  sends  a  modified  U-asg  to  all  of  its 
neighbors  except  the  neighbor  iron  which  it  received  the 
U-asg.  Nov  the  U-asg  is  updated  with  the  cuaaulative 
distance  froa  node  2  to  nod©  1.  Let  d(i,l)  be  the  channel 
value  on  the  link  from  a  node  i  to  any  neighbor  1.  Ihen  the 
cuaaulative  channel  value  froa  node  2  to  node  1  is 

d  (2, 1)  +  0(1)  *1+0*1. 

D  (1)  is  taken  froa  the  U-asg  received  by  node  2  from  node 
1.  d  (1 ,2)  is  calculated  at  soa©  earlier  designated  tiae 
when  all  nodes  in  the  network  simutaneously ..  calculate  and 
fix  channel  values  to  each  of  their  neighbors  (this 
procedure  is  discussed  in  greater  detail  in  Chapter  V) • 
Therefore  the  U-asg  relayed  to  node  2*s  neighbors  is 
U (2,1,1)  which  states  that  node  2  is  relaying  a  U-asg  froa 
node  1  and  the  cuaaulative  channel  value  through  node  2  to 
node  1  along  its  best  path  is  1. 

When  node  4  receives  the  U-asg  froa  node  2,  it  once 
again  processes  the  aessage  in  a  standard  fashion.  As  shown 
in  Fig.  4,6,  the  channel  value  froa  node  4  to  node  2  is  3 
(d  (4, 3)  «3)  •  Now  upon  receiving  the  U-asg  froa  node  2,  node 
4  calculates  the  cuaaulative  channel  value  through  node  2  to 
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Fig*  4.6. 


Bode  2  Belays  Bode  1*s  0-esg 


the  initiator  of  the  U-asg  (d=aode1).  For  node  4  in  this 
example 

d  (4,2)  t  0  (2)  ♦  3  t  1  ■  4. 

lihen  node  4  compares  this  yalue  with  the  latest  cunmulative 
channel  value  for  its  best  path  to  node  1  (which  node  i  will 
define  as  the  symbol  B  (d) )  it  will  find  that  it  is  acre 
efficient  to  go  thru  node  2  to  get  to  node  1,  or  B(1)*2. 
Hote  that  in  future  discussions  the  term  “Best  Path"  will 
iaply  the  optima  series  of  links,  whereas  B(d)  will 
indicate  a  specific  neighboring  node  which  a  transacting 
node  considers  as  the  next  downstreaa  node  on  the  best  path 
to  destination  d. 


59 


In  this  example,  node  4  receives  a  U-msg  which 
enables  it  to  improve  its  best  path  to  d.  Any  node  which 
changes  its  best  path  or  the  cummulative  channel  value  for 
its  current  best  path  must,  in  turn,  relay  this  information 
to  all  of  its  neighbors  (except  B  (d)  •  This  is  necessary 
because,  given  this  new  information,  an  upstream  neighbor 
may  have  an  opportunity  to  update  its  B  (d)  .  On  the  other 
hand,  if  a  node  receives  a  U-msg  which  does  not  change  the 
node's  8(d)  or  cummulative  channel  vlaue  to  d,  it  will  not 
relay  the  (J-msg.  This  is  acceptable  because  the  upstream 
nodes  already  have  access  to  the  current  route  which  is 
considered  more  efficient  than  a  route  through  the  node 
which  relayed  the  last  0-msg. 

Deletion  of  update  messages  is  an  important 
function.  If  the  network  were  not  allowed  to  eliminate 
useless  messages,  it  could  impose  a  significant  unnecessary 
burden  on  the  management  traffic  load.  In  a  network  of  8 
nodes,  there  are  approximately  8**2  best  paths.  If,  when 
each  node  initiated  an  update  operation,  every  other  node 
indiscriminately  relayed  the  update  message,  there  would  be 
a  minimum  of  approximately  Sx (number  of  links)  update 
messages  generated  when  each  node  originates  an  update  in  a 
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network  of  N  nodes.  Therefore  to  control  this  growth,  the 
first  node  to  receive  a  useless  U-asg  eliminates  it. 

Fig.  4.7  shows  the  complete  network  with  channel 
values  and  best  paths  froa  all  nodes,  to  node  1,  before  and 
after  update.  The  order  in  which  U-msgs  arrive  at  a  node 
can  significantly  affect  the  number  of  U-asgs  generated  in 
reaching  the  optimum  solution.  But  (assuming  static  values 
for  the  channel  values)  the  end  result  will  always  be 
optimum,  even  though  it  may  require  several  update 
initiation  cycles  to  stabilize.  The  following  is  a  sequence 
of  events  that  could  have  occurred  to  update  the  network  in 
Fig.  4.7. 

node  1  generates  U  (1,1,0)  and  sends  it  to  Bodes  2 

and  4. 

Node  4  receives  Node  t*s  U-asg.  Since  this  is 
already  its  B(1),  it  updates  its  net  channel  value, 
generates  U  (4,1,5)  and  sends  it  to  nodes  2,3,  and  5. 

Meanwhile  Node  2  receives  Node  1‘s  U-asg  upstream 
along  its  B(1),  updates  its  net  channel  value,  generates 
0  (2,1,1)  and  sends  it  to  Nodes  3  and  4. 

Node  2  receives  Node  4*s  U(4,1,5),  compares  it  to 

B(1),  and  discards  it* 
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Fig. 


4.7.  complete  a«t work  with  Chaaa«l  Falusa  and  BP(1)'3 


Node  3  receives  Node  4's  0(4, 1,5),  coapares  it  to 
its  latest  B  ( 1 )  and  discards  it. 

Node  5  receives  0(4, 1,5)  upstream  froa  its  3(1), 
generates  0(5,1,10)  and  sends  it  to  Nodes  3  and  6. 

Nov  node  4  receives  Node  2's  0  (2,1,1),  coapares  it 
to  its  last  B (1)  and  selects  a  nev  fl(1)=2.  Since  it  changed 
3(d),  Node  4  issues  0(4,1  ,.4)  to  Nodes  3  and  5  which  will 
eventually  be  discarded  by  both  nodes. 

deanvhile  Node  3  receives  Node  2's  0(2, 1,1),  updates 
its  B  (1)  and  generates  0(3, .1,3)  for  Nodes  4,5  and  6. 

Node  5  receives  Node  3's  0(3, 1,3),  finds  this  better 
than  its  previous  B(1)  and  sets  B(1)»3.  Nov  Node  5  must 
also  issue  0(5, 1,4)  to  Node  4  and  6. 

Node  3  receives  Node  5's  previous  0(5,1,10)  and 
discards  it.  Node  4  receives  Node  5's  later  0 (5,1,4)  and 
also  discards  it. 

Node  6  initially  received  Node  5's  0(5,1,10)  but 
retained  its  old  B(1)»3.  Later  Node  6  received  0(5, 1,4). 
this  time  it  finds  this  path  auch  better  and  sets  B<1)*5. 
It  also  issues  0  (6,1 ,6) to* node  3.  Eventually  Node  6 
receives  0(3, 1,3)  but  discards  it.  Finally,  Node  3  receives 
0  (6,1,6)  and  discards  it. 
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In  the  above  example*  the  senerio  would  have  been 


slightly  changed  had  messages  arrived  in  a  different  order* 
but  the  ultimate  best  path  results  would  be  the  same. 

2.  introducing  New  and  Broken  Links 

Realistically  a  network  must  integrate  new  links  and 
recover  from  broken  links.  Later  the  “Alternate  Link"*  as 
an  interim  fir,  will  be  discussed.  But  initially  we  shall 
assume  that  there  are  no  known  routes  remaining  from  the 
node  which  detects  the  broken  link*  to  some  destination. 
Assume  also  that  traffic  for  this  destination  may  already  be 
stored  in  the  detecting  node,  or  euroute  to  it  under  the 
assumption  that  the  broken  link  is  still  intact.  rhe 
network  management  protocol  must  provide  for  a  graceful 
recovery. 

In  order  to  eliminate  the  added  complexity  of  cycle 
numbers*  the  protocol  is  restricted  to  initiating  one  U-msg 
from  any  one  node  in  the  network  at  one  time.  This  means 
that  there  must  be  enough  time  for  an  update  cycle  or 
session  initiated  by  a  node  to  propagate  thru  the  entire 
network*  updating  all  best  paths  as  it  goes.  When  a  break 
cuts  off  access  to  a  node*  it  is  important  that  a  new  update 
from  that  node  (cr  nodes)  be  initiated  and  propagated  thru 
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the  network  as  soon  as  possible  in  order  to  identify  new 
best  paths  so  that  stalled  traffic  can  continue  to  their 
destinations.  In  order  to  address  this  problem,  the 
protocol  assigns  the  highest  processing  priority  to  U-msgs. 
This  is  intended  to  allow  u-asgs  to  perform  the  update  (and 
therefore  eliminate  themselves  from  the  net)  as  soon  as 
possible,,  it  the  same  time*  the  protocol  sets  the  frequency 
at  which  each  node  periodically  initiates  a  new  U-msg.  The 
idea  is  to  establish  a  practical  U-msg  initiation  frequency 
so  that  the  event  of  a  broken  link  does  not  require  a 
reguest  for  initiation  of  a  special  update  message,  and  yet 
does  not  leave  user  traffic  stranded  for  a  long  time. 

It  might  be  helpful  to  consider  an  example  of  this 
in  terms  of  the  user  service  protocol  example  in  chapter 
III.  ££  the  average  distance  between  nodes  is  approximately 
3  km  (based  on  the  Harine  Amphibious  Brigade  model)  then 
assuming  speed  of  light  propagation  the  signal  travel  time 
between  nodes  is 

3  km 

travel  time  *  . . . . —  as  ioew-5  sec  »  10  usee* 

3  x  10**5  k a/sec 

Furthermore  assume  a  network  or  basic  group  of  50  nodes,  and 
assume  a  longest  best  path  of  30  nodes.  then  the  maximum 
total  travel  time  is 
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30  links  x  10  usec/liak  9  300  usee. 

Assume  an  additional  20  usee  processing  tiae  in  each  node 
(when  protocol  aessages  are  given  top  priority).  Then  the 
total  tiae  for  a  U-osg  to  process  thru  the  entire  net  is 
approximately  1  msec.  Therefore  if  the  protocol  reguired 
each  node  to  initiate  a  U-msg  every  .Isec  (or  once  every  10 
frames) *  approximately  .Isec  ♦  1msec  is  the  longest  any 
traffic  should  be  stranded  due  to  a  broken  link.  This 
should  not  significantly  affect  data  traffic  which  is  bursty 
in  nature  anyhow.  Although  detectable  in  voice  traffic*  it 
would  not  be  serious  unless  failures  occurred  repeatedly. 
This  situation  could  be  improved  by  increasing  the  frequency 
of  the  update  at  the  cost  of  sore  network  management 
traffic. 

This  protocol  reguires  that  traffic  which  is 
stranded  due  to  a  broken  link  wait  to  be  rescued  by  a 
routine  U-asg  from  the  destination  node  to  which  the  traffic 
is  addressed.  yet  there  are  still  actions  which  can  be 
taken  to  make  good  use  of  the  broken  link  information  and 
minimize  the  trauma  of  recovery.  Since  there  is  no 
assurance  that  any  of  the  nodes  close  to  the  break  will  be 
on  the  new  best  path*  it  is  probably  helpful  to  freeze  data 
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traffic  enroute  to  a  broken  link.  This  is  one  of  the 
functions  of  a  broken  path  message  (X-asg). 


Fig.  4.8.  sending  the  x-asg  Upstreaa 


When  a  node  discovers  a  broken  link  on  cne  of  its 
best  paths,  it  initiates  a  X-nsg  for  every  destination  node 
for  which  the  discovering  nodes  considered  the  broken  link 
as  part  of  the  best  path.  These  nodes  are  easy  to  identify 
because  this  is  the  sane  information  used  for  normal  routing 
operations.  The  initiating  node  sends  the  x-asgs  to  all  of 
its  neighbors.  For  exaaple,  as  shown  in  Fig.  4.3,  when  Soda 
3  discovers  that  the  link  to  Hode  2  {and  8(1})  is  broken,  it 
will  initiate  an  x-asg  which  is  1(1).  Sote  in  this  exaaple 
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that  the  broken  link  could  also  be  node  3*s  B{2),  also 
requiring  a  X  (2)  message.  But  for  simplicity  it  is  assumed 
that  node  1  is  the  only  destination  in  this  network.  The 
X ( 1 )  is  sent  to  all  of  Node  3's  neighbors.  Node  4  and  6  do 
not  consider  Node  3  to  be  on  their  best  path  to  Node  1. 
Note  that  for  Node  4,  this  is  a  correct  assumption.  But  for 
Node  6  this  assumption  is  not  correct.  In  any  event,  if  a 
node  receives  a  X-msg  from  a  non-best  path  neighbor,  it 
discards  the  X-asg  and  takes  no  other  action.  This  is  how 
useless  x-rnsgs  are  eliminated. 

Node  5,  on  the  other  hand,  receives  X(1)  from  its 
B(1).  This  indicates  that  it  has  lost  its  best  path  to  Node 
1.  As  with  Node  3,  when  a  node  discovers  that  its  best  path 
to  d  is  broken,  it  freezes  any  data  traffic  in  its  buffer 
for  d,  and  issues  an  X-msg.  Therefore  Node  5  now  issues 
X  (1 )  to  Nodes  4  and  6.  Once  again  Node  4  ignores  the  X-msg. 
However  this  time  Node  6  has  received  the  x-msg  from  its 
8(1).  This  would  cause  Node  6  to  stop  sending  data  traffic 
until  a  new  best  path  is  found. 

At  the  User  Protocol  level,  which  may  employ  virtual 
links  as  described  in  Chapter  III,  the  X-msg  may  not  be 
enough  to  stop  all  traffic  routed  over  a  given  link  when  a 
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break  is  discovered.  A  virtual  link  fixes  a  .  route  at  the 

time  it  is  created,  for  the  duration  of  the  traffic  session. 

In  the  meantime,  subsequent  update  cycles  may  have  caused 

nodes  along  an  established  virtual  link  to  select  other 

nodes  as  B(d)  while  maintaining  its  virtual  link  thru  the 

node  wnich  was  the  B(d)  at  the  time  the  virtual  link  was 

created.  Therefore,  in  addition  to  sending  x-msgs  to  all 

neighbors  for  all  destinations  for  which  a  broken  link  was 

considered  a  best  path,  it  may  also  be  necessary  to  define  a 

# 

Virtual  Disconnect  message  which  would  be  relayed  upstream 
to  break  down  virtual  links.  In  fact  something  like  this 
would  probably  be  required  in  any  network  using  virtual 
links  to  break  down  the  virtual  links  when  users  have 
completed  a  routine  traffic  session. 

Because  of  the  frequency  of  the  U-msg,  it  may  not  be 
necessary  for  a  x-msg  to  wprk  its  way  all  the  way  upstream 
to  the  most  remote  node  on  the  best  path.  In  Pig.  4.9  Node 
2  could  have  issued  its  X(1)  after  Mode  1  issued  0(1, 1,0)  to 
Node  4.  In  this  case,  if  Node  4  had  not  yet  processed 

0  (1,1,0)  when  it  received  the  X(1)  from  its  8(1),  Node  4 
would  immediately  adopt  the  direct  link  as  its  8(1)  and 
issue  0(4, 1,5)  to  Nodes  2,  3,  and  5.  Since  Node  2  already 


Pig.  4.9.  I~asg  fleets  U~*sg 


froze  traffic  for  Node  1,  it  would  iaoediately  release  the 
traffic  to  Node  4  considering  Node  4  as  its  BO).  If  Node  3 
had  already  frozen  traffic  for  Node  1V  the  saae  would  apply. 
But  in  this  situation  it  is  liakely  that  a  new  best  path 
would  be  established  before  traffic  in  Nodes  S  and  6  were 
even  affected  by  the  broken  link. 

New  links  do  not  have  the  trauaatic  iapact  of  broken 
links.  4  new  link  represents  the  addition  of  a  new  neighbor 
for  the  two  nodes  on  each  side  of  the  link.  Since  the  link 
is  initially  unloaded,  it  is  likely  to  beeoae  a  priie 
candidate  for  a  link  in  several  best  paths  because  of  its 
low  channel  value.  It  is  necessary  to  guard  against 
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oscillations  here  which  can  be  done  by  assigning  arbitrary 
initial  average  channel  value  to  the  new  link  which  would 
enable  the  link  to  be  gracefully  integrated  into  the 
network*  In  tine,  as  the  link  becomes  used,  the  effect  of 
this  arbitrary  assignment  will  disappear.  Once  again, 
because  of  the  frequency  of  initiating  U-nsgs,  there  is  no 
need  to  request  special  updates  upon  the  discovery  of  a  new 
link.  It  will  be  integrated  into  the  network  quickly  enough 
just  by  normal  updates. 

3*  hltexGAtAjLia.k--_&.P-Iat.erlaJE.ik 

It  is  not  always  necessary  to  stop  traffic  in  the 
face  of  a  broken  link.  Ideally  every  best  path  would  have  a 
backup  path  so  that  when  a  broken  link  is  discovered, 
traffic  is  immediately  switched  to  the  backup  path  with 
minimum  ripple  in  network  traffic  flow.  But  this  may  not  be 
possible,  and  the  additional  complexity  in  the  protocol  as 
well  as  the  increase  in  the  volume  and  content  of  network 
management  messages  appears  significant. 

However,  as  explained  in  Appendix  A,  the  protocol  as 
described  in  this  chapter  provides  sufficient  information  to 
manage  the  basic  update  and  broken  link  functions,  and  with 
a  slight  increase  in  processing  at  each  node,  the  same 
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network  aanageaent  sassages  can  occasionally  provide  a 
real-tiae  routing  alternative  to  a  broken  link.  This  is 
called  an  alternate  link. 

The  alternate  link  is  identified  during  the  update 
operation.  For  example,  during  a  routine  Update  for  Node  1 
of  the  network  in  Pig.  4.10,  Node  2  will  send  U  (2, 1,2)  to 
Nodes  3  and  4.  Node  4  will  not  select  Node  2  as  its  B(1), 
and  would  normally  discard  the  U-asg.  However  if  Node  4 
sade  one  additional  coaparison,  it  aay  still  find-the  Node  2 
route  to  Node  1  useful. 


Pig.  4.10*  The  llternai#  link 

For  any  node  j,  by  comparing  the  cumulative  channel  ^ 
value  $0{1}}  of  the  last  relaying  node  CD  with  node  j*s 
current  cuaeulative  channel  value  along  its  best  path  to  d, 
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node  j  can  determine  if  traffic  passing  thru  node  1  can  also 
eventually  pass  back  thru  node  j.  Assuming  all  links  have  a 
minimum  channel  value  >0,  if  node  j's  cuaaulative  best  path 
channel  value  >=  D  (1) ,  then  node  j  is  assured  that  node  1 
does  not  pass  traffic  thru  node  j  in  order  to  get  to  d. > 
This  ainor  conclusion  provides  node  j  with  a  loop-free 
alternative  path  to  d  if  it  should  discover  a  break  in  its 
best  path.  This  alternative  says  nothing  about 
multi-destination  or  ia plied  loops,  it  only  offers  a 
temporary  fix  for  a  node  which  has  experienced  a  broken 
link. 

Going  back  to  the  example  in  Fig.  4.10,  Node  4  notes 
in  U(2,1,2)  that  0(2)  »  2  which  also  equals  the  cuaaulative 
channel  value  for  Node  4*s  0(1).  This  causes  Node  4  to  list 
Node  2  as  an  alternate  link  to  Node  1.  in  larger  networks, 
one  node  can  certainly  have  alternate  links  for  several  d»s 
as  well  as  several  alternate  links  for  a  single  d.  Node  3 
in  the  example  sets  B(1)  *  Node  2.  However  when  it  receives 
0<**#1«2),  it  will  list  Node  4  as  its  alternate  link  to  Node 
1.  Likewise  Node  2  will  pick  Node  4  as  its  alternate  link 
to  Node  1.  But  note  that  Node  4  can  not  rely  on  Node  3  as 
an  alternate  link.  When  Node  4  received  u  (3,1,4)  from  Node 
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3,  it  has  no  way  of  insuring  that  the  route  is  not  as  shovn 
in  Fig.  4.11.  therefore  in  the  absence  of  any  further 
overhead  traffic.  Node  4  discards  this  inforaation  as 
unreliable. 


Fig,  4.11.  Potential  Loop  situation 

The  iapact  of  alternate  links  is  not  clear.  If  a 
network  is  very  evenly  weighted  and  richly  connected,  each 
node  could  have  one  or  sore  alternate  links  to  aost  of  the 
other  nodes  in  the  network.  This  iaplies  that  broken  links 
aay  only  require  a  shift  in  traffic.  A  less  evenly 
distributed  network  would  have  soae  nodes  with  alternate 
links  and  others  without.  In  this  case  soae  X-asgs  aight  be 
avoided,  others  curtailed,  and  yet  others  unaffected.  At  a 
ainiaua,  the  alternate  link  concept  appears  to  add 
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additional  robustness  to  the  network 


At  best  it  say  allow 
the  Update  frequency  to  be  decreased,  cutting  down  the  rate 
of  aanagenent  traffic. 

D.  EXPANDING  TO  BELATED  GB0UPS  AND  FAMILIES 

Although  there  is  no  theoretical  liait  on  the  nuaber  of 
nodes  in  a  basic  group,  there  nay  be  practical 

considerations  which  sake  it  attractive  to  liait  this 
nuaber.  For  exaaple,  when  all  nodes  are  considered  part  of 
a  single  basic  group,  then  every  node  in  the  basic  group 
(which  includes  the  entire  network)  aust  record  a  B(d)  for 
every  other  node  in  the  network.  This  further  iaplies  that 
updates  for  every  individual  node  can  potentially  span  the 
entire  network.  As  the  nuaber  (N)  of  nodes  in  a  richly 
connected  network  grows,  the  nuaber  of  U-asgs  generated  (to 
complete  an  update  for  one  source)  under  worst-case 
conditions  approaches  3(H**2).  (See  Appendix  C) .  Therefore 
it  aay  be  convenient  to  partition  the  network  along 
operational  or  geographical  boundaries.  To  investigate 
this,  several  additional  definitions  aust  be  introduced. 

1.  More  .Def  initions 

In  the  top  half  of  Fig.  4.12,  all  the  nodes  in  a 
given  network  fall  into  one  of  sir  groups  nuabered  100  thru 
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600.  Nodes  within  a  particular  group  consider  that  group 
its  basic  group.  Hithin  a  basic  group  each  node  has  a 
unique  node  identity.  For  example,  in  Group  400 ,  there  is 
only  one  Node  2.  Outside  o£  a  node's  basic  group  are  other 
groups.  For  each  group  in  the  top  o£  Fig.  4.12,  there  are 
five  other  groups  called  Belated  Groups.  Note  that  related 
does  not  iaply  that  two  groups  have  a  coaaon  border.  For 
example,  Group  400  does  net  border  Group  200.  By  combining 
the  group  and  node  identity,  each  node  can,  once  again,  have 
a  unique  identity  in  the  network..  For  example,  Node  2  in 
group  400  can  uniquely  be  called  Node  402. 

Furthermore,  the  six  groups  in  the  top  o£  Fig.  4.12 
can  be  grouped  together  and  called  a  Fatally.  This  family 
could  also  have  a  unique  identity,  such  as  3000  in  Fig. 
4.12,  and  be  one  o£  a  number  of  £ dailies  which  coabine  to 
fora  a  large  network  of  nodes.  In  the  bottom  of  Fig.  4,12, 
there  are  four  families  nuabered  1000  through  4000.  Once 
again,  every  group,  in  every  family  in  the  bottoa  of  Fig. 
4,12  could  have  a  Node  2.  But  when  group  and  family 
identities  are  added  to  the  node  identity,  each  node  retains 
a  unique  identity.  To  fully  identify  Node  2  mentioned 
earlier,  it  can  now  be  called  Node  3402.  By  using  this 
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Fig.  4.12.  Groups  and  Faailias 


three  tier  identity  concept*  there  is  a  potential  to  reduce 
network  management  traffic.  There  is  no  requirement  to  stop 
at  three  tiers;  however  three  tiers  suffice  to  demonstrate 
the  principles* 

One  requirement  of  this  structuring  principle  is 
that  groups  and  families  must  retain  some  continuity.  That 
does  not  mean  that  groups  and  families  cannot  move  in 
relation  to  each  other.  It  simply  means  that  entire  groups 
and  families  can  not  distribute  all  their  nodes  randomly 
around  the  network.  if  the  network  must  tolerate  complete 
random  node  movement,  then  the  single  basic  group  concept 
seems  best  suited  to  control  the  network.  However  there  may 
be  several  situations  wherein  clusters  of  nodes  are  likely 
to  remain  geographically  and  operationally  close  while  being 
fluid  in  a  larger  network  of  nodes.  military  organisations 
are  a  good  example  of  this  structuring. 

2.  Efficiencies  of  grouping 

In  the  remainder  of  this  study,  any  reference  to 
node  identity  will  imply  the  full  identity  including  the 
node* a  basic  group  and  family,  if  applicable.  All  message 
formats  and  contents  are  also  the  same.  It  will  be  assumed 
that  all  nodes  know  their  assigned  group  and  family.  in  a 
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ailitary  network  for  exaaple,  the  group  could  represent  the 
battalion,  and  the  faaily  could  represent  the  Brigade. 

hs  shown  in  Pig.  4..  12,  individual  nodes  continue  to 
establish  links  with  neighboring  nodes  regardless  '  of 
arbitrary  boundaries.  Efficiency  is  available  by  changing 
the  processing  of  aessages  that  cross  these  boundaries.  The 
goal  is  to  reduce  the  nuaber  of  network  aanageaent  aessages 
that  travel  to  reacts  nodes  in  the  network  when  there  is 
soall  likelihood  that  the  best  paths  being  updated  by  these 
aessages  will  ever  be  used. 

Basic  groups  are  organized  to  contain  a  group  of 
nodes  which  coamunicate  frequently  with  each  other.  Every 
node  in  the  basic  group  has  a  best  path  to  every  other  node 
in  the  basic  group.  For  these  nodes,  which  constitute  a 
aini-natwork,  the  basic  network  aanageaent  protocol 
described  in  section  C  above  applies  directly,  however,  the 
node  to  node  protocol  will  establish  a  link  with  any  node  it 
can  contact.  therefore  a  node  say  find  that  it  has  a  link 
with  another  ncde  outside  of  its  basic  group,  this  is  where 
group/faaily  processing  begins, 

Fundaaen tally,  grouping  causes  nodes  to  treat 
related  groups  and  related  faailies  as  single  nodes,  while 
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still  maintaining  the  capability  to  contact  each  node  in  the 
net work.  Therefore  for  our  example  in  Fig.  4.12,  Mode  3402 
has  two-  other  nodes  in  its  basic  group,  five  related  groups, 
and  three  related  faailies.  Thus  Node  3402  maintains  a  best 
path  to  a  total  of  10  network  elements.  By  contrast, 
without  groups  Node  3402  would  be  required  to  maintain  best 
paths  to  57  individual  nodes  in  order  to  contact  every  node 
in  the  network.  It  should  be  noted  that  basic  groups  of 
only  three  nodes  is  probably  unrealistic.  Basic  groups  of 
10  to  25  nodes,  faailies  of  3  to  5  groups  and  networks  of  3 
to  5  faailies  would  fit  typical  ailitary  organizations. 
Although  there  is  probably  an  optimum  combination  for  a 
given  traffic  profile,  there  are  no  rigid  requirements  on 
grouping  sizes. 

During  the  course  of  a  normal  Update,  an  initiating 
node,  or  a  relaying  node  .will  send  a  U-asg  to  all  of  its 
neighbors.  The  receiving  node  (j)  checks  the  identity  (1) 
of  the  node  which  last  relayed  the  U(l,d,B(l})  message.  if 
1  is  not  in  Node  j's  basic  group,  and  if  1  dees  not  equal  d 
(indicating  the  last  relaying  node  did  not  initiate  the 
message).  Node  j  discards  the  u-msg.  If  l»d,  this  indicates 
to  Node  j  that  a  neighbor  .outside  Node  j*s  basic  group  has 
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initiated  an  Update.  If  the  neighbor  is  from  a  related 
group  (sane  faaily) ,  Node  j  coapares  its  cunaulative  best 
path  channel  value  for  that  related  group  to  the  net  channel 
value  through  1.  If  this  is  an  improvement.  Node  j  alters 
the  0-asg  with  its  d(i,l)-,  and  relays  the  U-nsg  to  all 
neighbors.  This  procedure  continues  until  this  U-nsg  can 
not  offer  an  inproved  best  path  to  any  other  node  or  until 
it  reaches  the  faaily  boundary.  If  Node  jas  previous  best 
path  was  superior  to  the  new  possibility.  Node  j  would 
discard  the  O-asg.  If  the  neighboring  node  (1)  which 
initiated  the  aessage  was  fron  another  faaily,  node  j  would 
Chech  its  current  cuaaulative  best  path  channel  value  to  i's 
faaily,  and  coapare  it  to  the  net  channel  value  through  1. 
4s  in  the  case  of  a  related  group,  if  there  is  an 
improvement,  the  U-asg  is  relayed,  otherwise  it  is 
discarded. 

Fig.  a. 13  serves  to  illustrate  Updates  across 
boundaries.  The  process  aay  become  clearer  by  tracking  a 
possible  sequence  of  events  during  a  routine  update 
operation.  In  Pig.  4.13,  the  dotted  triangles  pointing  away 
fro*  a  node  represent  that  nade*s  (pre-update)  best  path  to 
a  related  faaily  (if  the  U-asg  creating  the  best  path  had 


j£>  PREVIOUS  Best  Path  ►BP  after  Update 

Fig.  4.13.  Update  Across  Boundaries  (partial  network) 


crossed  a  family  boundary  after  being  initiated)  or  best 
path  to  a  related  group  (if  the  U-tasg  creating  the  best  path 
had  crossed  a  related  group  boundary  after  being  initiated) . 
The  dark  triangle  represents  the  updated  best  paths  after 
Node  1301  issues  an  update. 

When  Bode  1301  issues  a  U-asg  to  all  of  its 
neighbors,  the  nodes  in  basic  group  1300  will  update  like 
any  basic  group.  Nodes  1203  and  2202  will  also  receive 
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0(1301,1301,0).  node  1203  sees  that  this  0-asg  was 
initiated  by  one  of  its  related  group  neighbors,  and  after 
comparing  channel  values  with  its  old  best  path  through  node 
1202,  selects  node  1301  as  its  new  best  path  to  Group  1300 
(or  B  (1300) -node  1301).  This  also  requires  Node  1203  to 
adjust  and  relay  the  O-msg  to  all  of  its  neighbors.  node 
2102  receives  Node  1203»s  .D-msg  across  a  family  boundary, 
notes  that  it  was  relayed  but  not  initiated  by  Node  1203, 
and  discards  it.  It  is  discarded  because  this  particular 
version  of  Node  1301's  four  original  update  messages  (one 
for  each  link)  initially  crossed  a  Group  boundary. 
Therefore  all  subsequent  versions  of  this  u-asg  serve  to 
update  best  paths  to  Group  1300  within  its  faaily. 
Therefore  when  Node  1203  relayed  an  offspring  of  the  "group" 
version  outside  its  family.  Node  2102  discarded  it.  Node 
1202  keeps  its  best  path  to  Group  1300  through  Node  1303. 
node  1201  changes  its  best  path  through  Node  1203  and  relays 
the  U-asg  to  its  neighbors. 

Now  node  1103  notes  that  a  Group  1200  node  has 
relayed  an  U~asg  initiated  by  a  third  related  group  in  node 
1103's  faaily;  therefore  it  will  evaluate  this  message  in  an 
effort  to  improve  its  path  to  Group  1300.  Note  that  once  a 


O-msg  successfully  crosses  a  group  boundary  leaving  its 
basic  group,  it  continues  to  cross  other  group  boundaries 
until  it  no  longer  offers  a  shorter  best  path,  and  is 
discarded. 

The  same  considerations  apply  vhen  initially 
crossing  a  family  boundary,  as  will  be  seen  below.  Node 
1103  updates  its  best  path  to  Sroup  1300  and  relays  the 
0-msg  to  Nodes  1101  and  3102.  Node  1101  retains  its  path  to 
Group  1300  through  Node  1103.  It  so  happens  that  Node  3102 
currently  has  Node  1103  as  its  best  path  to  the  1000  Family. 
However  when  it  receives  the  0-asg  relayed  by  Node  1103,  it 
notes  that  it  was  not  initiated  by  Node  1103  and  discards  it 
since  Node  3102  is  not  interested  in  establishing  a  path  to 
Group  1300,  or  any  other  individual  group  in  th^  1000 
Family. 

Meanwhile  Node  2202  has  also  received  the  U-msg 
initiated  by  Node  1301.  Node  2202  updates  its  net  channel 
value  retaining  this  best  path,  and  relays 

0(2202,1301,0  (2202))  to  all  of  its  neighbors.  Node  2102 

* 

accepts  this  new  route  as  its  best  path  to  the  1000  Family 
in  preference  to  its  less  efficient  link  through  Node  1203. 
It  then  relays  the  tl-asg  to  its  neighbors.  Node  2101 
updates  and  relays  again. 


Hov  Node  3102  has  again  received  a  version  of  the 
u-msg  initiated  by  Node  130*1.  But  this  time  it  was  passed 
by  a  node  which  was  not  in  the  1000  Family,  indicating  that 
the  cumaulative  channel  value  in  the  0-msg  up  to  this  point 
represents  the  distance  along  this  proposed  path  to  the  edge 
of  the  1000  Family.  Node  3102  compares  this  to  its  current 
best  path  channel  value  to  the  1000  Family  (which  is  direct 
to  Node  1103),  and  picks  the  best  path.  In  this  example. 
Node  3102  found  that  it  was  more  efficient  to  travel  to  the 
1000  Pamily  through  the  2000  Family,  than  to  cross  the 
direct  link  to  Node  1103  (rather  unusual). 

To  use  this  routing  information,  the  Source  node 
addresses  traffic  to  the  destination  node  and  sends  the 
traffic  on  its  way.  If  the  destination  is  in  the  same  basic 
group  as  the  source,  the  source  has  a  best  path  direct  to 
the  destination  node.  If  the  destination  is  in  a  related 
group  (same  Family) ,  the  source  node  sends  the  traffic  on 
the  best  path  to  the  destination  node's  basic  group.  is 
soon  as  it  crosses  the  basic  group  boundary,  the  traffic 
will  reach  a  node  which  now  has  a  best  path  to  the  specific 
destination  node.  Similarly  for  inter-family  traffic:  it  is 
routed  on  the  source  node's  best  path  to  the  family  of  the 
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destination.  3  hen  it  crosses  the  family  boundary,  it  is 
routed  by  the  destination's  group  and  finally  when  it 
crosses  the  basic  group  .  boundary,  it  is  routed  to  the 
specific  node. 

The  oost  in  routing  inefficiency  entailed  by  the 
tremendous  reduction  in  overhead  traffic  offered  by  this 
scheae  is  obvious  froo  the  example  in  Fig.  4.13.  if  Node 
3102  wanted  to  coaeunicate  with  Node  1101  after  the  Node 
1301  update  (dark  triangles),  the  traffic  would  ultimately 
travel  through  nearly  every  node  in  the  figure,  when  if  fact 
Node  1101  is  only  two  links  away  froa  Node  3102.  Although 
it  has  been  established  that  it  is  shorter  to  go  froa  Node 
3102  to  Node  1301  than  to  Node  1103  in  this  case,  the  full 
trip  would  normally  be  shorter  by  the  aore  direct  route. 

Besides  the  reduction  in  overhead  traffic,  it  should 
also  be  noted  that  group  and  faaily  boundaries  would 
normally  be  selected  on  operational  boundaries,  so  that  a 
relatively  saall  amount  of  traffic  would  be  expected  to 
suffer  froa  this  self-inflicted  inefficiency. 

There  are  soae  ainor  exceptions  to  the  above  rules 
which  would  be  helpful  if  integrated  into  this  scheae.  For 
example,  any  node  on  a  boundary  with  a  non-best  path  direct 
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link  to  a  node  in  another  group  or  family,  need  not  reject 
or  purposely  break  this  link  simply  because  it  is  programmed 
only  to  use  that  node's  gro>up  or  family  address.  The  minor 
additional  overhead  of  retaining  direct  links  to  all 
neighboring  nodes  can  be  useful  in  recovering  from  broken 
links.  Both  the  broken  path  and  alternate  link  concepts 
described  for  the  basic  group  can  be  applied,  virtually 
unchanged,  to  the  group/family  processing  concept. 


Figure  4.14.  Broken  Paths  and  Alternate  Links  Across  Boun¬ 
daries 

A  broken  link  on  a  best  path  to  a  related  group  or 
family  causes  the  discovering  node  to  first  look  for  an 
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alternate  link.  In  Pig.  4. 14*  a  portion  of  a  network 
including  boundary  crossings  and  link  channel  values  is 
shown.  if  these  channel  values  had  existed  when  Node  1203 
last  updated.  Node  2102  would  have  retained  its  B(10Q0)«Node 
1203.  However  when  Node  2202  relayed  0(2202,1301,3)  to  Node 
2102,  Node  2102  would  see  that  0(2202)  *3  to  the  1000  Paaily, 
which  is  less  than  its  cuaaulative  best  path  channel  value 
to  the  1000  Paaily.  Therefore  Node  2102  would  keep  Node 
2202  as  an  alternate  link  to  the  1000  Paaily.  Then  if  Node 
2102  lost  its  direct  link  to  the  1000  Paaily,  it  could 
imaediately  switch  traffic  to  Node  2202  with  the  assurance 
that  traffic  would  not  enter  a  loop.  Conversely,  Node  2202 
could  not  pick  up  Node  2102  as  its  alternate  link  to  the 
1000  Paaily  because  Node  2102's  cuaaulative  channel  value 
(4)  is  greater  than  Node  2202* s  cuaaulative  channel  value 
(3)  . 

If  Node  2202  experienced  a  broken  link  to  the  1000 
Paaily  in  Pig.  4.14,  it  would  be  required  to  initiate  a 
broken  path  aessage  to  all  of  its  neighbors.  When  Node  2102 
received  X  (1000)  frca  Node  2202,  it  would  disregard  the 
X-asg  since  its  best  path  is  not  affected.  ifheu  Node  2204 
received  2(1000),  it  would  find  that  its  a  (1000)*  Node  2202 


indicating  it  had  lost  its  best  path  to  the  1000  Faaily,  and 
look  for  an  alternate  link.  If  daring  the  last  update  by 
Hode  1203  the  channel  walue  b  in  Pig.  4.14  were  such  that 

b  ♦  Node  2202' s  0(1000)  >=  Node  2102‘s  D(1QQ0) 

or 

b  ♦  3  >*  4, 

then  Node  2204  would  switch  traffic  for  the  1000  Panily  thru 
Node  2102.  If 

b  ♦  3  <  4, 

then  Node  2204  would  relay  the  X-usg  or  X(1000)  to  all  of 
its  neighbors.  And  the  process  would  continue  outward  froo 
the  broken  link  just  as  within  a  basic  group. 

In  this  discussion-,  it  should  be  noted  that  the 
basic  group  concept  of  network  aanagenent  protocol  can  be 
applied  directly  to  the  group/faaily  organization  of  the 
network,  with  sene  reguireuents  on  the  structure  of  the 
group  and  families.  The  idea  of  detached  nodes  in  the 
group/fanily  concept  is  a  special  case  which  will  be 
discussed  in  Chapter  VI.  Whether  or  not  the  group/faaily 
concept  should  be  inposed  on  the  network  is  a  function  of 
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aet*ork  size,  tie  user  traffic  profile  and  efficiency 
tradeoffs. 
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V.  SIMULATION 


A  primary  objective  of  the  simulation  was  to  test  the 
basic  algoritha  by  selecting  and  fixing  some  network 
parameters,  and  then  Baking  aultiple  runs  in  which  the 
reaaining  paraaeters  were  varied.  Though  limited  in  scope, 
the  simulations  validated  soae  of  the  mechanics  of  the 
algorithm.  This  included  originating  and  relaying  update 
messages,  which  further  resulted  in  selecting  and  updating 
best  paths  based  on  calculated  channel  values.  Both  the 
basic  group  and  faaily/group  concepts  were  tested.  "wo 
methods  of  calculating  channel  values,  both  using  a  variable 
time  duration  called  a  window,  were  also  investigated.  The 
test  network  is  shown  in  Fig.  5.1. 

Simulation  results  were  initially  compared  to  results 
obtained  using  static  routing  via  fewest  number  of  hops  over 
the  same  network.  Later,  selected  parameters  were  varied  to 
observe  the  stability  and  robustness  of  the  network  control. 
As  a  result,  several  basic  observations  were  made  about  the 
attributes,  efficiencies  and  limitations  of  this  management 
protocol  concept. 

The  broken  link  and  alternate  link  concepts  were  not 
part  of  this  initial  simulation.  If  the  basic  link 
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family  boundary 


—  -  —  —  group  boundary 


tig.  5.1*  test  network 

aanageient  concept  ultiaately  proves  to  be  worthwhile#  as 
these  initial  tests  suggest,  then  the  next  logical  step 
would  be  to  test  the  algoritha  under  the  added  strain  of 
gaining  and  losing  links. 
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The  simulation  was  conducted  using  the  SIHSCBIPT  II. 5 
simulation  language.  The  encoded  algorithm  is  listed  in 
Appendix  E.  several  sihscbipt  encoding  decisions  are 
discussed  later  in  this  chapter. 

A.  SIMULATING  A  USES  AND  MEASURING  EFFECTIVENESS 

In  order  to  observe  and  measure  the  relative 
effectiveness  of  the  algorithm,  a  simple  user  service 
protocol  involving  only  data  packets  was  integrated  into  the 
system.  User  traffic  sessions  were  generated  with  an 
exponentially  random  inter-arrival  rate  and  with  a  uniformly 
random  number  of  packets.  Both  the  rate  and  number  of 
packets  were  controlled  by  input  variables,  A  packet  either 
moved  thru  the  network,  or  waited  in  a  queue  if  the  required 
link  was  busy,  until  it  arrived  at  its  destination  where  it 
was  discarded  after  performance  data  eas  collected.  All 
traffic  sessions  (and  therefore  all  packets)  had  a  source 
node  determined  by  a  uniform  random  function  based  on  a 
transmit  factor  assigned  to  each  node.  Each  packet  also  had 
a  destination  assigned  by  a  similar  process.  Packets 
created  in  a  single  traffic  session  all  had  the  same  source 


and  destination 


One  measure  of  relative  efficiency  was  the  average  time 
(per  total  nodes  hopped)  it  took  packets  to  reach  their 
destination.  Other ,  perhaps  sore  significant,  measures  of 
effectiveness  involve  the-  amount  of  gueuing  delay  or  queue 
sizes  that  occurred  during  the  test.  Xhis  Has  observed  in 
several  ways. 

The  maximum  gueue  size  per  simulation  was  recorded  for 
9very  link  and  listed  after  every  run.  This  information 
varied  significantly  and  appeared  to  be  influenced  by  the 
large  influx  of  packets  during  the  initiation  of  traffic 
sessions. 

Half  way  thru  the  simulation,  a  group  of  links  having 
the  longest  queues  during  the  first  half  of  the  test  were 
selected  to  be  saapled  during  the  second  half  of  the  test. 
The  number  of  links  selected  was  an  input  variable.  The 
number  of  samples  per  links  was  also  an  input  variable,  but 
was  normally  set  at  1000.  The  resulting  distribution  of 
sample  sires  for  the  busiest  links  in  the  network,  appeared 
to  offer  a  stable,  more  representative  measure  of  the 
algorithm's  ability  to  process  packets.  The  average  sample 
queue  size  and  its  standard  deviation  was  also  calculated. 
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Other  checks  and  measures  included  the  average  number 
of  nodes  hopped  per  packet,  the  average  number  of  links  used 
for  a  node's  update  cycle,  and  the  longest  best  path 
established  anytiae  during  the  test.  Finally  there  are 
several  checks  to  report  if  packets  were  excessively 
delayed*  particularly  due  to  dynamical  changes  in  best  paths 
during  aessage  transmission.,  resulting  in  an  abnormal  number 
of  hops  to  the  destination. 

B.  PR0GBA8BIHG  SCHEBE 

The  simulation  program  was  organized  as  a  set  of 
subroutines  controlled  by  a  simulation  clock  (Fig.  5.2) 
which  is  an  inherent  feature  of  SXBSCRIPT.  Before  the 
simulation  begins,  the  routine  is  initialized  by  the  main 
program  which  includes  reading  input  variables,  dimensioning 
arrays  and  printing  out  various  input  parameters.  The  main 
program  also  schedules  the  events  on  the  simulation  clock 
which  starts  several  activity  chains  resulting  in  the 
generation  of  user  traffic,  the  periodic  update  of  the 
network  and  the  collection  p£  performance  data. 

The  aain  program  schedules  the  first  update  originated 
by  each  node  in  the  network.  This  is  begun  at  a  random  time 
thru  an  event  routine  called  HEW. UPDATE. BSSSAGE.  For  tho 
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Fig.  5.2.  Prograa  Organization 


designated  node,  this  routine  generates  a  U-tnsg  for  each  of 
its  neighbors  and  places  the  aessages  on  the  link  to  each 
neighbor.  the  routine  schedules  the  arrival  of  each  U-asg 


cq  t daw  cj-o  25  m  f 


after  a  pause  to  account  for  propagation  tiae  plus  message 
duration.  A  tiae  of  2as  .was  selected  for  the  simulation. 
Finally  this  routine  reschedules  the  designated  node  for  its 
next  update  origination  in  an  interval  which  was  based  on  an 
input  variable  explained  below. 

Once  a  tJ-msg  was  originated,  it  was  scheduled  to  arrive 
at  neighboring  nodes.  The  arrival  of  a  U-asg  was  handled  by 
a  routine  called  ARRIVAL. MESSAGE.  This  routine  is  the  heart 
of  the  update  operation  and  implements  the  update  portion  of 
the  algorithm  in  Chapter  IV.  The  ARRIVAL. HESS AGE  routine 
determines  whether  or  not  this  U-msg  should  be  relayed  to 
the  neighbors  of  the  receiving  node,  which  neighbors  to 
relay  it  to,  and  what  the  contents  of  the  relayed  message 
will  be.  It  simulates  the  processing  time  by  scheduling 
retransmitted  u-msgs  to  continue  after  a  brief  processing 
time,  U-msg  processing  time  was  set  at  0.1  x  the  packet 
processing  time  {.0001  sec)  to  reflect  the  priority  of 
U-msgs  and  their  small  relative  size. 

After  the  processing  time,  the  U-msg  is  placed  on  the 
next  link  by  the  COST. UPDATE. HESSAGE  routine  and  the  U-msg 
is  again  scheduled  to  arrive  at  the  next  node  in  the 
selected  transmission  time  of  2as.  This  process  continues 
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until  the  O-msg  arrives  at  a  node*  is  processed  by  the 
AaHXVAL. MESSAGE  routine  and  considered  no  longer  suitable 
for  retransmission  (due  to  an  excessive  net  channel  value) . 
The  result  is  the  creation  of  a  best  path  to  the  node  (group 
or  family)  which  originated  the  U-osg  from  every  other  node 
thru  which  the  message  successfully  passed  prior  to  discard. 

During  the  course  of  the  simulation,  as  link  queues  vary 
in  size,  channel  values  change.  One  of  the  most  significant 
observations  affecting  the  fundamental  algorithm  made  during 
the  simulations,  concerns  the  timing  of  when  channel  values 
may  be  calculated.  It  was  initially  conceived  that  during 
an  update  cycle,  a  node  could  calculate  its  channel  value  to 
a  neighbor  whenever  that  node  received  a  O-msg  from  that 
neighbor.  However  it  was  found  that  under  a  relatively  high 
traffic  rate,  some  node  (i)  might  relay  a-msgs  having 
selected  a  best  path  node  (j),  but  by  the  time  node  i 
received  relayed  versions  of  its  own  U-msg  its  channel  value 
to  node  j  might  have  changed  dramatically,  resulting  in  a 
loop  (See  Fig.  5.3) •  To  remedy  this  problem,  updates  were 
constrained  to  start  anytime  during  a  (relatively  large) 
time  interval.  This  interval  was  followed  by  another  equal 
size  interval  during  which  no  updates  could  be  started,  but 


existing  updates  could  be  processed.  The  minimum  size  of 
these  intervals  was  large  enough  to  insure  that  any  existing 
update  cycles  would  work  their  way  out  of  the  network  before 
the  next  series  of  updates  was  allowed  to  begin*  The 
calculation  of  channel  values  was  synchronized  in  each  node 
to  take  place  once  (and  only  once)  near  the  beginning  of  the 
first  (origination)  interval.  The  operational  feasibility 
of  this  synchronization  requirement  is  not  unreasonable,  for 
very  good  network  synchronization  will  be  a  likely 
requirement  in  order  to  take  advantage  of  the  benefits  of 
spread  spectrum  modulation  techniques,  position  location  or 
other  attractive  capabilities  of  digital  communication. 

In  the  simulation,  the  Bain  program  schedules  the  first 
channel  value  calculation  with  the  routine  CV. LATCH.  since 
this  takes  place  at  time  zero  of  the  simulation  and  no 
traffic  has  started,  all  links  are  initialized  to  the  basic 
channel  value  of  1.  Cf. LATCH  also  calculates  the  update 
origination  interval,  based  on  tbe  specified  update  interval 
which  is  an  input  variable  (OF. DATE. PERIOD) ,  and  reschedules 
itself  for  every  node  in  the  network. 

After  the  first  update,  the  CV. LATCH  routine  uses 
historical  queue  information  for  each  link  to  calculate  a 
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Pig*  5.3*  Possible  Result  of  Freguent  cv  Changes 


new  channel  value  foe  that  link.  This  value  is  based  on  a 
time  average  of  past  gueue  sizes  existing  at  that  node  over 
a  time  period  called  the  WINDOW.  The  channel  value  is  the 
integer  part  of 


TlQt 

WINDOW 


♦  1 


where 


Ql  3  gueue  .size  of  i  th  gu$ue 

<r£  *  time  interval  over  which  gueue  =  Qjt 
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summed  for  all  queue  measurements  not  older  than  the  WINDOW 
for  a  given  link. 

The  Hain  program  begins  to  schedule  traffic  with  an 
exponential  arrival  rate  based  on  an  input  variable 
(AVE. NEW. TRAFFIC. INTERVAL} .  Traffic  is  started  by  calling  a 
routine  called  NEW. PACKET. MESSAGE.  The  first  traffic  is 
generated  after  the  network  is  allowed  to  complete  one 
update  cycle,  thus  insuring  that  all  nodes  have  a  best  path 
to  the  other  nodes,  groups  or  families  as  appropriate.  A 
traffic  message  (referred  to  as  *•  session"  in  Appendix  E) 
involves  randomly  selecting  a  source  node,  destination  node 
and  the  number  of  packets  in  the  message.  The  selection  of 
the  nodes  is  a  function  of  input  variables  assigned  to  each 
node  which  dictate  the  relative  frequency  with  which  nodes 
will  transmit  and  receive.  The  routine  can  also  restrict 
destination  nodes  to  be  in  the  same  group  or  family  as  the 
source  node  for  a  given  percentage  of  the  traffic  messages 
(sessions)  based  on  additional  input  data,  the  routine  will 
send  the  first  packet  on  the  best  path  to  its  destination  if 
the  link  is  idle.  If  not  it  will  place  the  packet  in  a  link 
queue.  In  either  case,  all  other  packets  in  the  message  are 
placed  in  the  queue. 


when  a  packet  leaves  its  source  node,  it  is  assigned  the 
current  simulation  time  which  xs  checked  again  upon  arrival 
at  the  packet's  destination.  This  information  is  used  to 
compute  the  average  and  peak  times  for  packets  to  hop  N 
nodes.  Each  packet  counts  the  hops  or  nodes  it  passes  thru 
enrouta  to  its  destination  as  explained  later  in  this 
section. 

When  a  packet  leaves  f.or  its  first  best  path  neighbor, 
it  is  scheduled  tc  arrive  after  an  interval  representing  the 
packet  transmission  time,  which  is  an  input  variable  called 
PKT.XMH.TIME.  For  the  simulation  this  value  was  fixed  at 
50ms,  based  on  performance  factors  mentioned  in  Chapter  £11. 

Finally  SEW. PACKET. MESSAGE  reschedules  itself  for  the 
next  traffic  session  which  will  have  the  same  exponential 
inter -arrival  rate  mentioned  above,  but  will  result  in  the 
random  selection  of  a  new  source,  destination  and  message 
size  (number  of  packets} . 

Enroute  to  their  destination,  packets  arrive  at 
neighboring  nodes  which  is  simulated  in  the  AEIVE. PACKET 
routine.  In  this  routine  a  packet  is  checked  to  see  if  it 
has  reached  its  destination.  If  so  it  is  processed  in  a 
routine  called  COflJPLEIED.IHIP  discussed  below.  If  not  the 
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packet  is  processed;  routed  to  the  next  best  path  neighbor 
based  on  the  ID  of  the  family,  group  or  node  of  the 
destination  node;  and  then  either  forwarded  if  the  link  is 
idle,  or  placed  in  the  link's  queue.  ABIVE. PACKET  schedules 
each  arriving  packet  thru  the  COE. PACKET  routine  after  a 
processing  time  delay  which  was  a  test  parameter  fixed  at 
O.lasec  per  packet.  Finally  ABIVE. PACKET  goes  back  to  the 
queue  of  the  node  which  sent  the  last  packet.  If  another 
packet  is  in  the  queue,  it  is  placed  on  the  link  (by 
scheduling  an  AHIVE. PACKET  for  that  packet)  to  the  node 
which  just  received  the  last  packet.  If  the  queue  was 
empty,  it  is  designated  as  idle. 

Meanwhile,,  when  the  packet  scheduled  for  the  CON. PACKET 
routine  arrives,  if  the  link  to  its  next  node  is  idle,  it  is 
placed  on  the  link  and  scheduled  to  arrive  (ABIVE. PACKET)  at 
the  next  node  in  the  packet  transmission  time  (PKT.XdH.  TIME) 
mentioned  above.  If  not,  it  is  placed  in  the  queue  for  that 
link.  la  order  to  minimize  large-scale  loading  shifts  from 
one  link  to  another,  the  algorithm  does  not  change  the 
routing  of  a  packet  coming  out  of  a  queue  to  be  transmitted 
if,  during  the  time  the  packet  was  waiting  in  the  queue,  the 
best  path  to  its  destination  has  changed.  A  packet  keeps 


its  original  routing  unless  the  link  has  been  broken  (not 
covered  in  these  simulations)  and  newly  arriving  packets  are 
routed  thru  the  best  path  node. 

Eventually  the  packet  reaches  its  destination.  Here  it 
is  processed  by  the  COMPLETED. TEIP  routine.  This  routine 
collects  and  computes  performance  data  including  the  number 
of  nodes  hopped  by  the  packet,  and  trip  time.  It  increments 
a  counter  which  sums  the  number  of  packets  hopping  N  nodes 
and  records  the  highest  trip  time  for  U  nodes*  It  keeps 
track  of  the  number  of  packets  arriving  for  each  session  and 
sums  all  the  trip  times  fpr  N  nodes  so  it  can  later  be 
divided  by  the  total  number  of  nodes  making  N  hops  to 
calculate  the  average  trip  time  for  8  hops. 

After  four  equal  intervals  (quarters) ,  the  simulation  is 
stopped  with  the  STOP. SIMULATION  routine.  This  routine 
reprints  selected  input  data.  It  also  calculates  and/or 
prints  performance  data  for  the  simulation  up  to  that  point. 
Appendix  E  contains  an  example  of  the  full  printout  which 
includes  the  average  and  peak  packet  transit  time  for  H 
hops,  and  the  maximum  queue  for  every  link.  it  also 
presents  results  of  a  statistical  sampling  of  the  links  with 
the  largest  maximum  queues  during  the  first  half  of  the 
simulation. 
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The  (lain  program  schedules  the  QO. SAMPLES  routine  at  the 
mid-point  of  the  simulation.  This  routine  will  identify  the 
8  links  with  the  highest  queues  in  the  first  half  of  the 
simulation.  8  is  an  input  variable  (SUP. LINKS)  .  QU. SAMPLES 
then  schedules  a  routine  called  SAMPLE  which  samples  these  8 
links  in  the  second  half  of  the  simulation  with  an 
exponentially  distributed  time  between  samples  with  mean 
1/S,  where  s  is  another  input  variable  (NO. OF. SAMPLES) .  The 
queue  sizes  found  during  these  samples  increment  a  queue 
size  counting  array  called  QU.DISTB.  STOP. SIMULATION  prints 
the  results  of  this  queue  sample  (QU.JDISTB)  as  well  as 
calculates  the  average  queue  size  and  its  standard 
deviation.  After  four  reports  STOP. SIMULATION  halts  the 
test, 

C.  ABB  AYS  AND  TEMPORARY  ENTITIES 

SXKSCBXPT  is  an  excellent  programming  language, 
particularly  for  its  readability  and  simulation  oriented 
functions.  The  encoded  algorithm  and  related  routines  in 
Appendix  £  are  written  in  SIMSCBXPT  and  also  have  additional 
documentation.  However  the  organization  of  the  arrays  and 
attributes  of  the  "message"  and  "pack"  temporary  entities 
contain  several  subjective  encoding  decisions. 
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Understanding  these  organizational  decisions  will  help  when 
reading  Appendix  E. 

The  arrays  used  in  the  program  are  listed  in  Fig.  5.4 
There  are  one,  two  and  three  dimensional  arrays 
( 1-D,2-0,3-D) .  The  array  aaae  is  followed  by  its 
dimension  (s) ,  which  aay  either  be  variable  or  constant,  and 
by  the  different  leanings  for  the  subscripted  variable  (e.g. 
node  ID).  Below  each  array  name  is  the  meaning  of  the  first 
(1-D),  second  (2—0)  or  third  (3-D)  subscript.  Together  the 
subscripts  identify  a  variable  location  which  aay  be  used 
during  the  simulation. 

For  example,  the  first  array  (PAB.OP.OBP)  la 
1 -dimensional.  Its  size  is  the  sum  of  the  number  of  nodes, 
plus  the  number  of  groups  plus  25.  Arguments  of  this  array 
will  be  the  program  numbers  for  groups  (program  numbers  are 
explained  in  Appendix  *1 .  The  content  of  this  subscripted 
variable  is  the  family  of  the  group  in  the  argument. 

The  2  and  3  dimensional  arrays  are  read  similarly.  For 
example  SBP.SET  is  a  2-dioeasional  array.  The  first 
argument  is  the  count  number  of  the  link  to  be  sampled  which 
is  determined  by  the  QU.SABPi.BB  routine.  The  second 
argument  identifies  whether  the  variable  is  t bo  MtoN  or 
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1-0 


FAM.QF.GRP  (nc.  of  nodes*  gtps*  25)  — >  faaily  ID 
Ist-D  (prograa  ID  for  group  i) 

Q0.D2ST8  (250)  — >  saaple  count 
Ist-D  (queue  size) 


2-0 


LINK. ABLE  (no.  of  links  in  network,  2)  -->  node  ID 
Ist-D  (link  nuaber.) 

2nd-D  (  1*  1st  node  I  2*  2nd  node) 


TRACER  (2  x  test  duration/ave.  session  interval,  2) 
— >  no,  of  pkts 
Ist-D  {session  nunber) 

2nd-D  (  1»  original  pkt  count  for  this  session 
I  2»  pkts  which  reached  destination) 


CLOCK. DATA  (4  x  no.  of  nodes,  2)  — >  tine 
lst-0  (no.  of  hops  a  N) 

2nd-D  (  1*  net  tiae  for  all  pkts  hopping  8  nodes 
)  2*  highest  individual  trip  tine  for 
a  a-hop  pkt) 


H0P.CGU8T  (4 x  no.  of  nodes,  2)  —  >  no.  of  pkts 
Ist-D  (nuaber  of  hops  *  H) 

2nd-D  (  1  _  Hot  Used 

(  2»  no.  or  pkts  hopping  a  hops) 


SdP. SET 
iSt-D 
2nd-D 


a  selected  no  of  links,  2)  — >  node  ID 
saaple  link  ID  nuaber) 
i»  “froa"  node  id  |  2®  MtoM  node  ID) 


Fig.  5.4.  SiascBXPT  Arrays  (1  and  2  Diaeasioaal) 


"froa"  node  for  that  link.  The  subscripted  variable  is  the 
actual  identity  of  the  node. 

Finally  for  the  NEIGHBOR. LIST  array,  the  first  arguaent 
is  a  staple  counting  integer  corresponding  to  one  of  the 
above  node’s  neighbors  (a  node  aay  have  up  to  6  neighbors) . 
The  third  arguaent  describes  whether  the  subscripted 
variable  will  contain  the  ID  of  the  neighbor  node  (1) ,  an 
integer  (1  or  0)  indicating  whether  or  not  the  neighbor  is 
active  (2) ,  or  the  channel  value  to  this  neighbor  (3) . 
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3-D 


NEIGHBOR.  LIST  (no. of  nodes,  6,  3) 

— >  node  ID  or  &P/DCBN  or  c V 
Ist-D  (node  n‘s  xp> 

2nd-D  (a  number  listing  froa  1  to  6  of 
of  node  n's  neighbors) 

3rd-D  (  1*  neighbor  ID  T  2=  link  status 

|  3=  CV  froa  node  n  to  neighbor) 

BEST. PATH  (no.  of  nodes,  no.  of  nodes*  groups 
fancies.  2)  -->  node  ID  or  CV 
Ist-D  ("froa"  node  ID) 

2nd-D  ("to"  ID  of  either  node,  group  or  family) 
3rd-D  (  1«  best  path  neighbor 

|  2=  CV  thru  Best  path  neighbor) 


LINK. MONITOR  (no.  of  nodes,  no.  of  nodes,  3) 
— >  busy  signal  (1)  or  Q  size 


Ist-D 

2nd-D 

3rd-D 


“froa"  node  ID) 

»to»'  node  ID) 

1*  idle/busy  status 

j  2=  current  queue  size 

i  3=  max  queue  size  thus  far) 


Fig.  5.5.  SIMS CRIST  Arrays  (3  Diaensional) 


Another  advantage  of  SXMSCBIST  is  the  ability  to  create 
and  destroy  multivalued  variables  called  temporary  entities. 
By  using  these  entities,  groups  of  data  can  be  shuffled  and 
processed  thru  queues  relatively  easily.  Another  advantage 
is  an  efficient  utilization  of  aeaory  space  because  entities 
which  are  no  longer  needed  can  be  destroyed  and  the  memory 
freed  for  reuse. 

The  algorithm  in  Appendix  £  used  two  temporary  entities 
extensively*  The  first  is  the  MESSAGE  entity.  As  shown  in 
Fig.  5.6  the  MESSAGE  entity  is  used  for  both  U-msgs  and 
packets.  There  is  more  information  in  the  SIHSCBIBT  U-asg 
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MESSAGE 


Type 
Eelayer 
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Info 
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packet  serial 
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Info 
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Info 

4 

H/A 

tine  released 
frca  source 

Info 

5 

group  of 
originator 

faaily  or  group 
non- basic  group 

PACK 

Nuaber 

Eq try. Sloe 
Pac. Neighbor 


gueue  size  due  to  last  change 

titte  gueue  changed  to  above  size 

neighborino  node  to  which  the 
gueue  has  been  changed 


fig.  5.6.  SiasCBXPX  Teaporary  Entities 


than  in  the  theoretical  U-*sg  of  Chapter  IV  siaply  for 
efficiency  of  pcograaaing  and  data  collection*  Note  that 
several  attributes  of  the  Update  MESSAGE  and  Packet  MESSAGE 
have  the  saae  aeaniag  and  others  do  not. 

The  PACK  entity  {Pig.  5.6)  is  used  in  the  CV. LATCH 
routine  to  calculate  all  link  channel  values.  A  pack  is 
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created  every  tine  a  queue  size  increases  or  decreases. 
PACKS  are  kept  in  a  queue  (called  TIHE.QOEOE)  assigned  to 
each  node.  They  are  kept  until  the  PACK'S  ENTflT.TIHE  (the 
tine  it  entered  the  queue)  is  older  than  the  window.  Each 
PACK  has  a  NUHBEH  which  is  the  new  queue  size  which  caused 
the  PACK  to  be  created.  Sacs  node  aay  have  several  links, 
but  all  PACK  are  kept  in  the  sa^e  queue.  Therefore 
p AC. neighbor  identifies  which  packs  belong  to  each  link  for 
a  given  node. 

D.  SELECTION  OP  TEST  P ABA METE BS 

Por  the  purpose  of  the  simulation,  certain  test 
parameters  were  selected  to  be  fixed  and  others  varied.  Por 
the  fixed  parameters,  approximations  were  made  based  on  the 
estimated  performance  char  act.  eristics  of  a  typical  system  as 
described  in  Chapter  III.  Pig.  5.7  lists  the  major  system 
and  simulation  parameters.  There  is  no  explicit  distinction 
between  fixed  and  varying  parameters.  However  the  estimate 
of  16,000  bps  bit  rate  in  Chapter  111  helped  settle  on  a  set 
of  processing  and  transmission  times  for  messages  estimated 
to  range  from  less  than  100  bits  (U-msg)  to  approximately 
1000  bits  for  packets.  The  ranges  of  the  varying  parameter 
were  also  affected  by  the  .16  Kbps  bit  rate  estimate  on  one 


110 


These 


_ _ _ 


end,  and  by  a  performance  threshold  on  the  other, 
results  are  discussed  in  greater  detail  in  Chapter  71. 


FIXED  PARAMETERS 


Pkt  Processing  Time  in  a  Mode 
Qrasq  proc^ss^ng  T^ae  in  a_Sode 


ransaissioh  Tim?  per  Link  , 

flfafi  »?mr  e?o  4  i  m  o  n  ar  IijJliC 


m  ? _  ___ r  _ 

G-ssc  Transmission  Tree  per 
Humber  of  pkts  per  session 
(uniformly  distributed) 

Links  to  be  sampled 
Ho.  gf  Samples  per  4nk 
Seceiving/Transaitting  factors 
4 for  each  node) 


.0001  sec 
.00001  sec 
.05  sec 
.00  2  sec 
1  -  20 
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1000 
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71&YX86  PARAMETERS 


Period  Between  Updates 
Simulation  Time  Limit 
period  Between  Hew  Traffic  Sessions 
tfmdow  Size 

%  InnarHSrcup/Family 


.01-1  sec 
<=  2000  sec 
.05  -  .1  sec 
1  -  20  times 
update  period 
0  -  75  * 


Fig,  5,7*  System  Parameters 

Other  input  data  consisted  of  a  description  of  the  test 
network  (Pig.  5.1)  including  the  identification  of  nodes, 
groups,  families  and  links.  The  network  topology  was  fired 
for  all  simulation  runs. 
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VI.  MIL  C0KCL05IQMS  AND  RECOMMENDATIONS 

The  results  and  conclusions  discussed  in  this  chapter 
primarily  involve  the  simulation  of  the  update  portion  of 
the  protocol  in  Chapter  17.  Furthermore,  in  view  of  the 
vide  variety  of  parameters  that  could  have  been  varied  in 
■these  simulations,  many  were  fixed  at  what  was  considered  to 
be  reasonable  approximations  based  on  performance  figures 
used  to  describe  the  theoretical  system  in  Chapter  III.  The 
analysis  centered  around  several  parameters  which  were 
considered  potentially  to  have  the  broadest  affect  on  the 
system  response,  including  the  interval  between  update 
massages  (or  the  rate  at  which  updates  were  originated)  ,  the 
average  arrival  rate  of  new  traffic  sessions  (or  at  the  rate 
at  which  packets  were  created) ,  and  window  size. 

A.  RESULTS  AND  OBSERVATIONS 

one  of  the  first  simulations  involved  assigning  a  fixed 
channel  value  of  1  to  all  links  in  the  test  network  (Fig. 
5.1),  defining  the  best  path  between  any  two  nodes  as  the 
first  path  found  with  the  lowest  net  channel  value  (also 
called  the  shortest  path),  and  then  fixing  all  best  paths 
for  the  entire  simulation.  This  is  a  static  routing  scheme. 
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using  shortest  direct  paths  in  the  sense  o£  minimum  number 
of  hops.  This  fundamental  network  scheae  was  used  to 
establish  a  minimum  performance  level  and  was  used  to 
measure  the  effectiveness  of  the  update  program  in  Appendix 
S.  For  the  network  in  Fig.  5.1,  all  best  paths  were 
calculated  and  frozen  at  the  beginning  of  the  siaulation. 
Then  traffic  sessions  were  originated  at  intervals  of  .05 
sec  and  .08  sec.  The  network  quickly  congested.  At  an 
interval  of  0.1  sec  the  network  settled  down  with  average 
sampled  queue  lengths  froa  2.2  to  3.1  for  a  2000  sec 
siaulation. 

The  remainder  of  the  simulations  involved  the  update 
algorithm  applied  to  the  saae  network  (Fig.  5. 1) .  The  tests 
were  divided  into  twc  groups.  The  first  and  largest  group 
of  simulations  considered  the  whole  network  to  be  one  basic 
group  (all  groups  and  family  ID*s  were  the  same).  This  is 
essentially  unfreezing  the  static  network  by  applying  the 
update  algorithm.  The  second  group  of  simulations  involved 
the  partitioning  of  nodes  into  groups  and  families  which 
could  then  be  compared  to  the  basic  group  simulations. 
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1 .  Basic  Sroup  Tests 


For  the  test  network  (Fig.  5.1),  the  frozen  path 
baseline  scheme  could  not  function  at  a  new  traffic  session 
period  of  less  than  0.1  sec.  The  basic  group  tests  results 
(Appendix  D)  suggested  that  0.1  sec  was  also  a  good  limit 
for  the  Update  algorithm.  However  runs  at  new  traffic 
session  periods  of  .08  sec  and  .OS  sac  indicated  a  gradual 
loss  of  efficiency  indicated  by  excessive  queue  lengths. 
The  static  network,  on  the  other  hand,  had  demonstrated 
catastrophic  failure  at  these  intervals.  Huns  at  intervals 
averaging  greater  than  0*1  sec  caused  very  little  strain  on 
the  update  algorithm,  therefore  the  traffic  inter-arrival 
interval  of  0.1  sec  average  was  selected  for  the  large 
majority  of  the  basic  group  (and  gxoup/family)  tests. 

At  an  average  traffic  inter-arrival  interval  of  0.1 
sec,  a  message  (session)  averaging  10  packets  was  added 
randomly  to  the  network  at  a  rate  of  10  messages  (sessions) 
per  second.  Simulation  results  indicated  that  after  100 
seconds  of  simulation  clock  time,  any  residual  effects  of 
starting  the  simulation  were  undetectable.  Therefore  test 
results  were  taken  for  simulation  runs  varying  from  100  to 
1000  sec.  Buns  greater  than  1000  sec  gave  no  indication  of 
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new  information  about  tie  length  of  queues  or  the  rate  at 
which  packets  could  be  processed.  Therefore  using  an 
average  message  (session)  arrival  time  of  0.1  sec  and  a  test 
duration  from  100  to  1000  sec,  the  primary  focus  of 
simulations  were  on  the  update  period  (or  rate  at  which  new 
update  cycles  were  started)  and  window  size. 

The  update  period  directly  reflects  the  amount  of 
overhead  required  by  the  network.  in  the  static  network, 
the  overhead  requirements  are  minimal,  amounting  to  that 
required  to  initially  establish  the  best  path  network. 
Therefore  it  is  reasonable  to  expect  better  performance  for 
an  increase  in  overhead  traffic.  The  basic  group  test 
indicated  this  improvement. 

The  average  queue  size  was  the  primary  measure  or 
performance.  The  figures  derived  are  conservative 
calculations  since  the  sampling  in  the  second  half  or  the 
test  was  made  of  the  busiest  links  found  in  the  first  half 
of  the  test.  The  static  networks  average  queue  length  for 
a  traffic  inter- arrival  interval  of  0.1  sec  was  2*  packets. 
The  basic  group  algorithm  approaches  the  static  network  as 
the  0 pda to  period  approached  infinity.  Fig.  6.1  shows  the 
decrease  in  average  queue  size  as  the  traffic  session 
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.01  .1  1.  10 

UPDATE 

INTERVAL 

(sec) 

The  curve  labelled  '•MAX”  Is  the  plot  of  the  largest 
average  queue  sizes  over  the  set  of  experiments. 

The  curve  labelled  “filN”  is  the  plot  of  the  siallest 
average  queue  sizes  over  the  set  of  experiments. 

Fig.  6,1.  Queue  Size  vs  Session  Interval  (Basic  Group) 

interval  size  decreases.  As  expected#  for  relatively  long 
update  intervals  (>1  sec)#  average  queue  sizes  ranged 
between  1  and  3  packets.  From  there#  as  the  update  interval 
decreased#  average  queue  sizes  dropped  quickly.  Around  0.1 
sec#  the  average  queue  size  settled  into  a  range  of  values 
between  approximately  .25  and  .75  packets.  Baay  runs  were 
aade  in  this  range  and  there  was  no  tendancy  for  results  to 
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prefer  any  particular  part  of  this  range  as  the  test 
duration  was  varied.  Results  were  very  stable  (see  Appendix 
0) . 


Pig.  6.2.  window  Calculations 


Window  size  was  also  varied  to  determine  its  impact 
on  average  queue  size.  At  first  the  channel  values  ware 
calculated  over  various  window  sizes  based  on  a  linear 
weighted  time  average.  The  weighting  scheme  gave  the 
highest  weights  to  the  aost  recent  queue  sizes.  However 
simulation  results  showed  that  this  scheme  resulted  in 
larger  average  queue  sizes  than  a  straight  unweighted  time 
average  as  shown  in  Pig.  6,2  The  height  of  the  blocks 
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represent  the  size  of  the  queue.  Their  width  represents  the 
length  of  tiae  that  the  queue  did  not  change  in  size.  The 
window  indicated  how  far  back  on  the  tiae  line  (in  Fig.  6.2) 
the  program  would  go  te  calculate  the  average  queue,  and 
therefore  the  channel  value  for  a  particular  link. 

Window  size  also  proved  to  be  a  very  stable 
parameter.  Window  sizes  between  1  and  10  times  the  update 
period  gave  no  indication  of  influencing  the  curves  shown  in 
Fig.  6.1  As  the  window  size  increased  to  over  20  times  the 
update  period,  there  were  slight  increases  in  average  queue 
size. 

The  standard  deviation  of  the  average  queue  size  for 
basic  group  tests  varied  slightly  from  1.2  to  2.3  packets, 
with  the  smallest  standard  deviation  for  update  periods  of 
0.1  sec. 

.  2. 

The  basic  group  test  results  were  compared  to  a 
fundamental  static  network  routing  scheme.  The  family/ group 
tests  results  (Appendix  D)  were  primarily  compared  to  the 
basic  group  results.  Although  tne  proposed  advantages  of 
the  family/group  aspect  of  the  update  algorithm  presented  in 
this  paper  axe  based  on  the  assumption  that  the  majority  of 


the  traffic  is  confined  to  inner  group  or  inner  family 
transactions.,  most  of  the  family/group  tests  placed  no 
restrictions  on  which  node  sent  or  received  traffic.  Under 
these  conditions,  the  same  set  of  messages  with  the  same 
sources  and  destinations  used  in  the  basic  group  tests  were 
used  in  the  family/group  tests.  Suns  involving  restricted 
traffic  is  briefly  mentioned  at  the  end  of  this  section. 

As  expected,  the  average  queue  size  increased  in  the 
family/group  tests.  For  update  periods  ranging  from  .05  to 
0.5  3qc,  average  gueue  sizes  varied  from  0.5  to  1.5  packets. 
Additionally,  the  standard  deviation  increased  to 
approximately  3.7  to  4.2  packets.  The  benefits  due  to  this 
drop  in  performance  was  the  decrease  in  overhead  traffic. 
Typically,  the  average  number  of  links  used  by  U-msgs  as  the 
result  of  a  single  node  originating  one  update  cycle  during 
the  basic  group  test  ranged  from  75  to  90  links.  This  is 
because  every  node  had  to  have  a  best  path  for  every  other 
unde.  For  a  typical  family/group  test,  the  average  number 
of  links  used  dropped  to  around  23  to  27  links.  Therefore 
for  a  (roughly)  50  percent  improvement  (decrease)  in  maximum 
average  queue  size,  a  200  percent  increase  in  overhead 
traffic  was  required. 


Another  effect  of  the  family/group  algorithm  is  an 
increase  in  the  average  number  of  nodes  hopped  by  all 
packets.  Because  of  the  addressing  given  to  a  packet 
starting  out  for  a  node  in  a  different  family  (it  starts  out 
with  a  family  best  path  neighbor) ,  more  average  links  are 
normally  required  in  family/group  tests.  An  interesting 
observation  is  that  occasionally  a  few  (most  often  1  or  2  in 
more  than  20,000)  packets  in  a  family/ group  test  would  make 
an  unusual  number  of  hops,  clearly  indicating  that  it  is 
looping  due  to  changes  in  its  best  paths.  ho&cver, 
invariably  the  total  time  required  for  this  packet  to 
finally  reach  its  destination  was  well  within  the  average 
rimes  required  by  other  packets  which  used  far  fewer  hops. 
The  cause  of  these  (relatively  rare)  oscillations  is  not 
obvious.  It  is  probably  due  to  the  large  number  of  links 
which  cross  a  group  or  family  boundary.  During  an  update 
each  link  represents  an  entry  port  to  that  particular 
related  group  or  family  and  each  acts  as  an  originator  of  a 
U-#sg  for  that  larger  entity  (or  super-node)  .  Therefore 
from  update  to  update,  the  best  path  port  to  that  super-node 
could  change  by  a  large  physical  distance.  However  it  is 
not  clear  if  this  observation  indicates  a  serious  problem. 
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since  the  packets  still  invariably  arrive  in  a  timely 
fashion.  As  a  safeguard,  an  additional  routine  was  added  to 
the  simulation  program  to  check  the  hop  count  on  all 
outstanding  packets  when  the  test  ended.  At  no  time  was 
there  an  indication  that  an  undelivered  packet  was  looping 
or  making  excessive  hops. 

Compared  to  the  basic  group  simulations,  relatively 
fewer  runs  were  made  for  the  family/group  tests.  However 
these  results  suggested  that  as  the  ratio  of  window  size  to 
session  interval  increased  over  the  range  from  1  to  10, 
average  gueue  size  also  increased  slightly.  Additional 
testing  may  indicate  that  a  relatively  flat  performance  band 
similar  to  Fig.  6.1  also  exists  in  this  case. 

Finally  several  runs  were  made  with  the  same  test 
network  with  the  additional  restriction  that  50  percent  of 
all  traffic  is  inner  group  and  50  percent  of  the  remaining 
traffic  is  inner  family.  There  were  too  few  runs  to 
establish  *  trend.  However  the  results  suggested  a  decrease 
in  average  queue  size  and  standard  deviation. 

3.  COHCLOSXOHS 

This  was  very  much  a  preliminary  investigation  of  this 
network  management  protocol.  It  would  be  improper  to 
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identify  ouch  more  than  broad  performance  characteristics  or 
trends. 

The  update  algorithm  clearly  functions  properly.  Both 
the  basic  group  concept  and  the  fastily/group  concept 
responds  to  changing  channel  values  and  provides  routes  that 
can  be  used  under  a  reasonable  traffic  load.  The  algoritha 
is  also  very  stable  and  robust.  Fig.  6.1  indicates  that  for 
a  traffic  session  interval  of  0.1  sec  and  longer,  the 
algorithm  has  a  good  and  very  flat  performance  curve  for  an 
update  period  of  approximately  0.1  sec  aud  less. 

Investigating  the  update  interval  should  continue  to  be 
a  focal  point  in  future  analysis.  For  a  given  network 
perforaance  level  it  will  always  be  important  to  minimize 
the  update  interval,  since  it  reflects  the  overhead  traffic 
that  the  network  must  process. 


On  the 

other 

hand. 

as  new  and 

broken 

links 

are 

integrated 

into 

the 

simulation. 

they 

will 

add 

counter- arguments  to  the  continued  increase  in  the  update 
periods.  is  links  are  broken,  if  alternate  links  are  not 
available,  nodes  rely  on  U-asgs  to  unfreeze  traffic  and 
provide  new  best  paths.  Therefore  future  analysis  must  find 
a  balance  that  will  optimize  this  situation. 
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The  family/group  concept  provides  very  good  economy  (and 
robustness,  as  compared  to  gateway  nodes)  with  a  modest 
decrease  in  performance.  For  networks  which  operate 
extensively  within  smaller  sub-network  boundaries  (such  as  a 
typical  military  network)  ,  the  family/group  concept  appears 
to  offer  a  significant  savings  in  overhead  traffic  compared 
to  the  same  network  operating  as  one  basic  group. 

C.  RECOMMENDATIONS  FOB  FURTHER  STUD! 

This  preliminary  study  indicates  that  the  update  portion 
of  the  decentralized  routing  protocol  described  in  Chapter 
IV  accomplishes  the  fundamental  requirement  of  routing  user 
traffic.  Follow-on  investigations  are  needed  to  integrate 
the  new  and  broken  link  concepts  described  in  Chapter  IV. 
wherever  possible,  the  program  in  Appendix  E  was  written  to 
facilitate  this  next  step  in  the  investigation.  It  can 
similate  the  loss,  gain,  and  the  planned  movement  of  nodes 
by  scheduling  the  failure  and  awakening  of  links  on  the 
simulation  clock.  Both  single  node  and  group  movements 
could  be  simulated. 

This  protocol  was  conceived  to  be  simple  and  practical. 
A  degree  of  simplicity  has  been  retained.  However  to  become 
a  practical  protocol,  there  are  several  topics  which  need  to 
be  considered,  that  are  not  addressed  in  this  study. 
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The  primary  problem  is  how  to  cope  with  splintering. 
Splintering  aay  be  a  single  node  which  crosses  a  group  or 
family  boundary.  If  this  problea  is  applied  to  a  single 
basic  group  network,  it  then  reduces  to  the  problea  of  a 
node  leaving  the  network  or  a  new  node  entering  the  network. 

Splintering  aay  also  be  defined  as  groups  of  nodes  being 
conpletely  cut  off  froa  the  other  nodes  in  its  basic  group. 
This  sub-group  aay  be  left  to  operate  autonomously  or  find 
itself  in  the  aiddle  of  another  basic  group.  A  practical 
exaaple  based  on  the  military  organizations  mentioned 
earlier  would  be  the  aovemeat  of  a  company,  which  is  part  of 
a  battalion's  basic  group  net,  thru  another  battalion's 
sector.  It  is  conceivable  that  the  company  may  lose  all 
direct  links  with  its  basic  group  during  the  movement.  A 
practical  protocol  must  also  accommodate  this  splintering  to 
the  point  where  a  basic  group  is  divided  into  two  or  more 
equal  parts,  leading  to  the  guest ion  of  determining  which 
group  is  the  splinter  and  which  is  the  remainder  of  the 

original  basic  group. 

Finally#  assuming  a  practical  protocol  can  be  fully 
developed,  there  is  the  much  more  difficult  problea  of 
measuring  its  efficiency  both  in  an  absolute  sense#  .  and  in 
relation  to  other  existing  decentralized  algorithms. 
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ALIEBNATE  LINK  TflEOBX 

CLAIM:  During  a  shortest  path  update  process,  it  may  be 
possible  to  identify  an  alternate  link  which  may  be  used  to 
maintain  traffic  flow  (although  at  some  degraded  level)  in 
the  event  that  a  node's  IMMEDIATE  DOWNSXBEAM  link  in  a 
particular  shortest  path  is  broken.  The  switch  will  result 
in  a  non-optimum  but  LOOPFBEE  network.  LOOPFfiEE  in  this 
discussion  implies  loopfree  in  the  narrow  sense.  That  is, 
traffic  leaving  a  node  for  a  given  destination  is  assured 
that  it  will  not  loop  back  into  the  sending  node. 

DISCUSSION:  Simply  stated,  the  concept  is  that  some 
optimum  path  routing  algorithms  may  acguire  information  that 
is  normally  discarded,  but  may  be  used  at  individual  node 
level  to  switch  traffic  to  an  alternate  link  if  a  break  is 
found  in  that  node's  immediate  downstream  link  along  the 
optimum  path.  This  switch  does  not  necessarily  leave  the 
rest  of  the  network  optimally  routed,  but  it  is  LOOPFHEE* 
It  may  be  useful  as  a  temporary  fix  until  the  next  update 
process  is  received. 

PBOOF:  Any  set  of  shortest  path  routes  in  a  network  can 
be  expressed  as  a  spanning  tree,  which  is  always  loopfree. 
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In  the  following  examples,  the  spanning  tree  is  vertically 
scaled  to  represent  the  channel  value/distance  to  the  tree 
root.  Every  link  is  assumed  to  have  a  minimum  value  of  1, 
however  this  is  not  critical  in  the  proof. 

A  loop  implies  that  a  route  passes  through  the  same  aode 
more  than  once. 

If  every  link  has  a  minimum  value  of  1,  then  the  total 
distance  for  each  node  in  an  optimum  spanning  tree  to  the 
root  must  be  at  least  one  larger  than  the  next  aode 
downstream. 

Therefore  a  loop  cannot  exist  in  a  spanning  tree  because 
once  traffic  leaves  a  node  in  a  spanning  tree,  it  will  never 
arrive  at  a  node  of  equal  distance  to  the  root.  Under 
normal  operations,  if  more  than  one  node  has  the  distance  to 
the  root  of  d,  then  a  particular  message  for  that  root  will 
only  pass  through  (at  most)  one  of  these  nodes  of  distance 
d.  Furthermore,  once  traffic  reaches  a  node  of  distance 
less  than  d,  it  will  never  pass  thru  any  node  of  distance  d 
under  normal  traffic  flow  conditions. 

consider  the  following  network  and  spanning  tree  with  k 


126 


as  the  root 


Applying  the  concept  that  a  aessage  will  only  pass  thru 
one  node  of  distance  d  to  the  above  spanning  tree,  we  see 
that  if  a  aessage  is  4  units  away  froa  node  A,  it  is  ElSHEfi 
at  node  D, E  or  E.  the  aessage  will  be  at  one  of  these  three 
and  will  never  pass  thru  the  other  two. 

Siailarly,  if  a  aessage  at  node  G  was  transplanted  in 
node  o  or  a  aessage  in  node  a  was  transplanted  in  node  c 
(where  C  and  D  both  have  distances  less  than  H  and  G)  the 
aessage  could  continue  to  the  root  without  ever  passing  bach 
thru  the  initial  node  (H  or  G) .  Kote  that  this  is  not  the 
case  if  a  aessage  in  node  c  was  transplanted  in  node  Q« 
that  node  H*s  distance  is  greater  than  node  c's 


Hote  also 


1  wzmmrmBgg'Btei 
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8 
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distance  to  the  root.  This  is  an  indicatoc  that  a  loop 
condition  is  possible. 

Relieving  the  above  network  diagram  we  see  that  there 
are  many  unused  links  i£  traffic  to  A  is  restricted  to  the 
Best  Paths  (—»—») .  However  if  an  established  best  path  is 
broken,  these  links  provide  a  potential  bridge  which  may 
transplant  traffic  from  the  node  which  discovers  a  broken 
link,  to  an  adequate  adjacent  node  which  circumvents  the 
broken  link.  The  necessary  and  sufficient  factor  to 
determine  whether  an  adjacent  node  is  adequate  is  its 
distance  to  the  root  A.  As  long  as  the  adjacent  node's 
distance  to  A  is  less  than  or  equal  to  the  distance  via  the 
broken  Best  path  link,  traffic  transferred  to  it  will  never 
loop  back  to  the  transferring  node  (and  presumably  will 
proceed  to  node  A)  • 

application:  consider  a  simple  algorithm  where 
cuamulative  distance  to  the  root/sink  was  used  to  determine 
the  Best  Path.  At  each  node,  one  best  path  would  ultimately 
be  selected  over  others.  Xn  making  this  selection  each  node 
learns  the  best  path  distance  to  the  sink  thru  its  adjacent 
neighbors,  adds  its  distance  to  each  adjacent  neighbor  and 
picks  the  Best  Path.  However  the  best  path  distance  from 
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the  non-selected  adjacent  neighbors  may  still  be  useful.  If 
this  distance  is  <=  the  node's  best  path  distance  to  the 
sink,  and  if  the  node  detects  a  break  in  its  best  path  link, 
it  aay  transfer  traffic  around  the  broken  link  by  using  one 
of  the  adjacent  nodes,  with  the  assurance  that  the  new  path 
is  loop  free.  It  is  perfectly  conceivable  that  more  than 
one  alternate  link  may  be  available  to  a  given  node  an  one 
time.  Using  the  network  and  the  tree  shown  above  as  an 
example,  we  have: 


NODE/ 

(distance  to  A) 


POSSIBLE  ALTERNATE  LINK(S)/ 
(distances) 


B/ 

C/ 

D/ 
B/ 
F/  4 
G/  1 
H/  5 
X/  6 


1 

2 

4 

41 


None 

None 


Q/l 


E/(4) 

’l  t 

one 

13: 

None 


D/  (4) 

m 


Note  that  the  transferring  node  must  still  add  the  link 
distances  from  it  to  the  selected  adjacent  node  before 
picking  the  shortest  alternate  path. 
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DISTRIBUTED  PROTOCOL  ALGORITHM 


•**•*«•*«*«****«*««********•*•«**«****•**«*««*****•**«•**«•***«•********• 

SYMBOLS  AMD  DEFI3XTXOH5 


ALI 


SX'(d)  «■>  Message  to  neighbor  Indicating'  it  has'  bean  selected 
3(d)  ■*>  Neighboring  node  on  best  path  to  d  (G/d  oc  r/d}* 

*  (3/d  or  F/d)  Indicates  that  group  or  faaily  identities  can  be 
use  in  the  argnagnt  of  these  synbols  in  place  of  d  to  define 
intra-group  and  intra-faeily  operations. 


ath 


G/n  *■>  Group 
F/n  »»>  Faail 


i^entit^  of. node  n 


irnt  «*>  channel  value  ^fd?staace)  of  link  froe  node  i  to  node  n 

9  (ni  *«>  Distance  froe  node  n  to  node  d  on  its  best  path 

d1  d,  g/5  or  P/d  for  inner  group,  intra-group  or 

intra-f aaily  operations  as  required 
T3ANS  Originate  or  relay  a  eessage  ta 
BUT  ■•>  Mo  further  action  required 


So  appropriate  neighbor (a) 


»*«*****«e«e*«**«e*eee**eMft*e«*****«*e**«*e**MM*e*eeee«ee*«*eeee*eee*eee 

l.  UPDATE  I Mill AXIOM 


1.  XBt^0(l,d,DU))  to  all  neighbors  where 
D  (1)  -  0 


XX.  Schedule  next  Update  origination  in  daaignatad  Update  period. 
•3.  RECEIVE  /  PEOCBSS  UPDATE 

X.  3cv  0(1, d, 0(1))  at  node  i,  6  G/l  •  C/i 
1)  G/i  ae  (not  equal)  G/l 

EX XT  w. 


2)  Xf 


3} 


T 

SXXT 
XC 


.yuM';  Ijif1* 

AU&,a<aiM»  nd)’ 

“jdLiWi 

IroS&usifr DW* d(t<M 


a 

L 
t 
EXIT 


**» 


u?,i,  6,A<*»  <•  DO) 

A  (<S);"  A  (A)  0  1 

AUa.l):-  fa(l) 

EXIT 


S|  If 


6  1C  A(d) 


XX.  8CV  0(L,9,9(L) )  AS  MODS  X  0  G/X  38  G/D  G  1/1  •  I/O 
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.fc: 


I- 

t- 


I-  H 


ri»:  apb 


?:m 


SITU  POSXGIADOASB  SCHOOL 


1)  If  7/i  St  7/1 

BSIt 

2)  lfgG£i  »  G/d  s  1  a.  d 

3)  If  BJG/d)  *  1 

MM*raa»!»JBffls" 9*M 

Bill 


4)  .if  8<Ri  JA& 


(1J+  d(i,l)  <«  P  (G/d)  S  B(G/d) 
A^%? :  *<A  (i/^r  0 

if*^wrdf,!’  M^di 

_  A(G/d)«  1 


a.  I 


***** 

BUS. 


5>  If  3 

k< 


<**  0  (8/d) 


6)  If  0 
A  • 

e: 


(G/d)  n«  1  6  0(1) 

i*7  1 


III.  act  tJ(L,0,D(tn  At  HOCB  I  &  7/1  IS  7/D 

1)  Xfg?£l  *  P/d  6  1  0.  d 

2)  if  8(r/aj 


ll©wfe»SWI! 


D(L)  ♦  0  (X#L) 


EXIT 


3)  If 


8(P/d)  “ 1 

* (7/4)’-  .A  (#>9)  U  B#<r>d) 


l(?, 

X 

BXIS 


da-11 

CIS 

3»  t**  Xim>~  1 

19.  A»jft s|f£ic4  frox.n  da.  to  X(d«J  iM  c.l..s.d  is  soon  ..  .  a.« 


1*  s#l»ctad. 
c.  aaosi'S  link  phocbss 

1.  Bad.  1  disaos.cs  link  with  &od*  j  im  ksok«tu 
?os  «.cb  d*  a.t»  B0I  •  j  s 
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FILS:  APB 


PISH 


BA Tit  POSTGBADOATE  SCHOOL 


i»  MnM4!U?f  2 


A (d’l  for  which  AL(Md'}*d*)*  4(i#A(4»)| 

iLs  3.?**  Md,) 


2) 


s:»  AL(n»d*) 

3 (d*J !*  B 
Ljd'U*  * 
trims  ax(4»)  to  a 
EXIT 


IX. 


Pra«a~£raific  l»stia«ShIOE*4* 

yr.| :  s 

EXIT 

ter  Xfd'l  at  aoda  i  froa  uodo  l 

lt*UVxU  s  5)  AHOfE 


2)  If  B(d*)  BO  1 
EXIT- 

III.  acr  AZ(d')  at  aodo 
If  any  4WM..J.  X 


ifroa  nod*  1 


132 


APPENDIX  C 


WO 2 ST  CASE  GEOWTH  0?  UPDATE  MESSAGES 

It  is  unlikely  that  any  distributed  routing  algorithm, 
which  attempts  to  balance  traffic  on  all  links  in  a  busy 
network  and  takes  a  finite  time  to  update  a  network,  will 
9ver  produce  a  network-wide  routing  scheme  which  is  truly 
optimized.  For  example,  delays  due  to  propagation  time  and 
processing  time  in  each  node  will  cause  a  time  difference 
between  the  node  which  originated  the  update  and  the  last 
node  which  was  affected  by  that  origination.  During  this 
period,  particularly  under  heavy  traffic  loads,  conditions 
which  existed  in  and  around  the  originating  node  at  the  time 
the  update  was  started  may  be  very  different  from  those 
existing  by  the  time  the  most  distant  node  is  updated. 
Generally,  the  longer  it  takes  for  an  update  cycle  to 
propagate  throughout  the  network,  and  the  longer  the  time 
between  update  cycles,  the  sore  conditions  could  change, 
thereby  degrading  an  ideal  routing  scheme.  Therefore  it  is 
germane  to  consider  how  long  it  would  take  for  an  algorithm 
to  optimize  a  network  if  a  sudden  change  in  link  status 
caused  a  worst  case  situation. 
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It  is  important  to  understand  that  the  following 
analysis  assumes  that  after  the  status  (e.g.  loading)  of  the 
links  have  changed,  they  are  theoretically  frozen  until  the 
network  achieves  re-optimization.  aithout  this  assumption, 
as  stated  above,  it  may  be  impossible  to  arrive  at  a  fully 
optimized  routing  scheme  in  a  changing  network  at  any  point 
in  time. 

For  the  algorithm  presented  in  this  paper,  under  worst 
case  conditions,  it  could  take  up  to  (approximately) 
3x(n**3)  update  messages  to  optimize  a  network  of  n  nodes, 
the  following  figure  shows  a  richly  connected  network. 


#  Indicates  CV  to  neighbor 

£  Indicates  net  CV  to  Node  1 
on  Seat  Path 

(#)  Indicates  new  CV  at  next  update 


Network  k  shows  the  best  paths  to  Node  1  as  of  the  last 
update.  To  naintain  the  worst  case  conditions,  we  will 
assuae  that  the  channel  values  of  the  links  inside  the 
network  (the  star)  are  always  so  large  that  they  will  never 
be  selected  as  a  best  path  link  to  Node  1.  However  each  of 
these  links  will  require  that  another  u-asg  be  sent  each 
time  a  node  at  either  end  updates  its  current  best  path  or 
adopts  a  new  one. 

The  channel  values  in  parenthesis  in  network  B  represent 
changes  in  the  channel  values  since  the  last  update  and  will 
be  used  in  the  next  update  cycle  originated  by  node  1.  4S 
the  first  update  cycle  begins,  all  nodes  receive  a  U-nsg 
froo  node  1  (for  n»5  nodes,  a-1  U~osgs  are  initially  seat 
out  at  the  beginning  of  a  cycle).  It  is  assuoed  that  (under 
worst  case  conditions)  the  U-asg  is  relayed 
counter-clockwise  (CCM)  thru  node  Z  upstreaa  along  the  best 
path  arriving  at  node  S  sooetiae  after  nodes  5,4  and  5  have 
rejected  the  direct  U-osg  froa  node  1  (because  they  eoapared 
their  outdated  net  best  path  channel  value  to  the  current 
channel  values  in  the  u-asgs.). 

is  the  0-asg  thru  node  2  works  itself  upstreaa  along  the 
best  path,  it  updates  each  node*s  net  best  path  channel 
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value  and  causes  each  node  to  relay  the  update  to  all 
neighbors  except  the  sending  node  (n-2  relays  for  n-1  nodes) 
causing  a  relay  of  (n-1)  (n-2)  U-asgs.  Adding  the  original 
n-1  U-ssgs  from  node  1; 


(n-1)  (n-2)  ♦  (n-1)  =  (n-1)  (a- 2+1)  =  (a-1)**2. 


In  this  first  update  cycle,  (n-l)#*2  U-osgs  have  gone  out 
and  not  a  single  node  has  changed  its  best  path  neighbor  to 
node  1.  But  this  was  still  a  significant  step  because  each 
node  now  knows  the  true  distance  along  its  best  path  to  node 
1  as  shown  in  Network  C. 


node  2  works  its  way  CCS  to  node  5  before  node  5  receives 
its  U~asg  direct  froa  node  1.  This  is  nearly  a  repeat  of 
the  previous  cycle  causing  another  (a-1)**2  U-asg  to  be 
initiated.  However  when  the  U-asg  direct  from  node  1 
finally  arrives  at  node  5,  node  5  picks  a  new  best  path 
(direct  to  node  1)  and  relays  the  U-asg  to  all  neighbors 
(except  the  sending  node).  Shen  node  4  receives  node  5's 
u-asg,  it  selects  this  new  best  path,  informs  all  neighbors 
and  the  process  continues  until  the  network  has  now  selected 
the  optiaum  routing  scheae  as  shown  in  Network  D. 

This  final  series  of  U-asgs  involving  (n-1)  (a-2) 
transaissions  brings  the  total  U-asgs  generated  over  the  two 
update  cycles  (originated  by  node  1)  to 

2  (n-1) **2  ♦  (a-1)  (n-2) 

which  is  approximately 

3((n-1)#*2)  — >  3  (a#* 2)  . 

since  there  are  n  nodes  in  the  network,  each  initiating 
its  own  update  during  a  single  network  update  cycle,  the 
total  (worst  case)  auaber  of  U-asgs  possible  is  3(n**3) 
(over  two  network-wide  update  cycles  in  this  exaaple) . 
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SIMULATION  EESOLIS 

This  appendix  illustrates  many  of  the  results  of  the 
simulation  runs  for  the  program  in  Appendix  E.  For  all 
results  in  this  annex,  the  only  parameters  varied  were  the 
Update  period,  window  size  and  rime  limit/duration  of  the 
simulation  run.  Data  is  divided  into  two  major  areas;  basic 
group  test  results  (3G)  and  faaily/group  test  results  (F/G) . 
Eech  plot  corresponds  to  the  Update  period  size  indicated  to 
its  left.  The  plotted  data  is  the  average  queue  size  for  a 
run  derived  from  sampling  10  links  (those  having  the  highest 
average  queues  over  the  first  half  of  the  simulation  run) 
approximately  1000  times  each  during  the  second  half  of  the 
simulation  run.  Sesults  for  a  given  test  duration  are 
represented  by  a  number  corresponding  to  the  size  listed 
adjacent  to  the  plot.  The  vertical  axis  is  average  queue 
size.  The  horizontal  axis  is  the  Bi&dow/Update  Period 
ratio. 
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APPENDIX  E 


SIMULATION  PROGRAM 


Fits:  DOC 


amt  POSTGRADUATE  school 


//HOBNAH2X  JOB  (2034,0058)  ,'HBBITSCB  1052', CL ASS»A 
/ /* HUS  LISES*  (15) 

//  EXEC  SIB25CLG,flEGION.GQ*1  024K,PA8M.GO*iHAP,S2ZEb760K< 

//SYSPEINT  on  SYSOOT*A 

//*-TSPFINT  DO  DISP*SHR,ONIT*33S0,7OtaSEI*aVSOQ4,OSN«S2O34.COMPIlI, 
//*DCB* (HEC?a*FB,LBECL-133,BLKSI&E*4l23) 

//sia.sYsta  dd  * 

PREAMBLE  v, 

1 1  v 

NORMALLY  SODB  IS  IMTEGES 
GENERATE  LIST  ROUTINES 

t 1 

PERMANENT  ENTITIES 

EVERT  NODE  HAS  A  TRANSMIT. PERCENT,  A  RECEIVE. PERCENT,  A  GROUP, 

A  ? A. II LI,  OWNS  A  QUEUE  AND  A  TIME. QUEUE 
DEFINE  TRANSMIT. PERCENT  AND  RECEIVE. PEE CENT  AS  SEAL  VARIABLES 

TEMPORARY  ENTITIES 

EVERT  MESSAGE  HAS  A  TYPE,  A  RELAIEB,  A  NEXT. STOP,  A  DESTINATION, 

AN  CNFOI,  AN  XHF02,  AN  INFOS,  AN  IBPG4,  AN  INFOS  AND  NAT  BELONG  TO 


A  QUEUE 

DEFINE  INF04  AS  A  REAL  VARIABLE 
EVERT  PACK  HAS  A  N0NBE3,  AN  BNTBI. TINS, 

BELONG  TO  A  TIME.QUEUB 
DEFINE  TINE. QUEOE  AS  A  LIFO  SET 
DEFINE  KNTST.TXNS  AS  A  REAL  74 81 ABLE 

i  • 

5VTNT  NOTICES  IKCLODB  STOP. SIMULATION,  QU. SAMPLES 

-  -  -  .  — idxhS. 


A  PAC.IBIGBBOB  AND  MAX 


SAMPLE,  CV. LAICS 
A  TT PE. NESSAGE 


EVENT  NSU. UPDATE. MESSAGE  HAS  A  SENDING. NODE,  AN 5 
EVERY  ARRIVAL. NESSAGE  HAS  AS  ID , MESSAGE. NUMBER 

EVERT  CONT, UPDATE.  NESSAGE'  HAS  A  LAST. NODE,  A  NEXT. NODE,  A  NET.CV*. 

A  SOURCE,  A  FA. MILT,  A  HOP.CNT  AHD  A  GB.OUV 
EVERT  ARIVE. PACKET  HAS  AN  ID, NUMBER 
EVERY  CON. PACKET. MESSAGE  HAS  AN  XDSNT. MESSAGE.NUBBE# 

DEFINE  UP. DATE. PERIOD,  PROCESSING. TIME,  PKT.XNN.SXNB  AND  TXOB.LIliIS 
AS  REAL  VARIABLES 
SFINE  TRNS.PCNT  A* 

DEFINE  LINKS  AS  A  VARIABLE 
DEFINE  SS6.HLT  AS  A  VARIABLE 

DEFINE  rSIGUBOR.LIST  AS  A  3-DIMENSIQMAL  INTEGER  ARRAY 

DEFINE  BEST. PATH  AS  A  3-DIMSNSIONAL  IRTSGRR  AISAX 

DEFINE  CHANNEL. VALUE  TO  MEAN  INTOI 

DEFINE  FAH.LX  TO  MEAN  INrQZ 

DEFINE  GRP  TO  MEAN  INFOS 

DEFINE  GRPS,  FNLTS  AND  TOPS  AS  VARIABLES 

DEFINE  LINK. ABLE  AS  A  2-OIHEN5IONAL  A&BAf 

DEFINE  LNK. MONITOR  AS  A  3-DIHBNSXOBAt  ABBAS 

DEFINE  TRACER  AS  A  2-OIMENSIONAL  ARRAY 

DEFINE  CLOCK. DATA  AS  A  2- DIMENSIONAL  HEAL  AUU 

DEFINE  HOP. COUNT  AS  A  2-OIMENSIONAL  ARRAY 

DEFINE  SMP. SET  AS  A  2-OXMJ,HSXONAL  ARBAT 

DEFINE  QU.DISTR  AS  A  1 -DIMENSIONAL  ABBA! 

DEFINE  : AM.QF.GRP  AS_  A  1- DIMENSIONAL  A* RAT 
DEFINE  IDLE  TO  MEAN  0 
DEFINE  BUST  TO  MEAN  1 
DEFINE  PACKET  TO  MEAN  2 

DEFINE  AVE. NEB. TRAFFIC. INTERVAL.  PKT.MIN  AMD  PAT* MIX  AS  REAL  VARIABLES 
DEFINE  SST.MAX.OP. T3APPIC  AND  TOT. NBB.TRAFFIC  AS  VARIABLES 
DEFINE  TS AitS. NUMBER  TO  MEAN  INFO! 

DEFINE  PACK. NUMBER  TO  MEAN  INF02 
DEFINE  NODES. HOPPED  TO  MEAN  INF03 
DEFINE  RELEASE. TIME  TO  HEAR  IBFG4 
DEFINE  (FK.GP  TO  MEAN  IMFOS 
DEFINE  YES  TO  MEAN  1 
MEIN  0 


DEFINE  SO  TO 

DEFINE  - 

D  E~rNE 

D EFINB  V INDOB  AS  A  SEAL  VARIABLE 
DEFINE  UP.PAC. RATIO  AS  A  REAL  VAR I AM Ut 


UPDATE  TO  BEAR  1  . 

TN A?. LIMIT  AS  A . VARIABLE 
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GROUP 

(poa  •) 


WL 


DEFINE  PRNT  is  i  VARIABLE 

DEFINE  IN. GROUP,  IH.FAMILT,  SELECTOR  AS  REAL  VARIABLES 
DEPTHS  NET.  U.LlSlKS,  UP. STARTS.  MAX. U. HOPS  AS  VARIABLES 
DEFINE  TX.RER  AS  A  REAL  VARIA6LE 

DEPTHS  SRP. LINKS,  HO. OP. SAMPLES.  SNP.CNT8  AS  VARIABLES 
DEFINE  EARLIEST. UPDATE  AMD  LATEST. UPDATE  AS  REAL  VARIABLES 
DEPTHS  U.X8N.TIEE  AS  A  REAL  VARIABLE 
DEFINE  PEEK  AS  A  VARIABLE 
END  ««Or  PREA8BLE 

hah 

;««  SET  SORE  VARIABLES 

•tt  SET  THE  RANGE  OP  PACKETS  PER  SESSION  (PKT.8IN  /  SAX) 

•tt  SET  A  LIMIT  ON  THE  NB332R  OP  SESSIONS  (TRAP.LIHIS) 

•tt  SET  AN  UPDATE  8SG  TO  PACKET  PROCESSING  RATIO  (U.PAC. RATIO) 

•tt  SET  AN  UPDATE  8SG  TERMINATION  TIRE  (O.XRN.IIRE)  . 

LET  PKT.HIN  >  %. 

LET  PKT.8AX  •  21. 

LET  T3AP.LIHXT  >95000 
LET  UP. PAC. RATIO  •  ,1 
LET  U.XRN.TXHS  *  0.002 

;;««  READ  AND  PRINT  INPUT  DATA 

READ  N. NODE 

PRIST  2  LINES  AS  FOLLOWS 
NODE  TRANSMIT  RECEIVE 

NO.  P ACTOR  FACTO K 

CREATE  EVERT  NODS 
FOR  EVERT  NODE 

j:s  f8?§i'1!5»5,8»§gl6lcE!!‘SS»igl!,!"S.g5nIa!Ss§l?  ISS«gTgB5SSt.?‘S58Sifc3 

«  INPUT  PAEXLT  NUMBERS  ARE  ADDED  TO  N.XODS  ♦  THE  HIGHEST  GROUP  SUUNBI 
;j*«  TO  GET  THE  PROGBAH  PAHILt  NUMBER. 

POR  I  «  1  TO  N.NODR,  00 

1ST  TRNS.PCKT  «  TRHS.PCNT  ♦  TRANSMIT.  PERCENT (X) 

L2T  RCJ.PCNT  «  RCV.PCNT  ♦  RECEIVE. PERCENT (X) 
s?  Gaps  <  GROOPir)  * 

tST  GRPS  -  GROUP (X) 

^  ^  REGARDLESS  , 

J \tt  SET  PROGKAB  GBP  HUH 

1ST  GROUP  (I)  -  G80UP  (X)  *  N.VODB 

RESERVE  PAH. OP. GRP  <*>  AS-  (GBPS  ♦  M. NODE 
POR  I  «  1  TO  N.NOOB*  1)0 
IP  PMLTS  <  PAMLTjEl 
LET  FRITS  -  PARUnX) 

t  t regardless 

SET  PBOGRAB  PAM  NOB 

18?  FAHILT  (II  >  N.NODS  *  GBPS  ♦  PAfllLt(X) 

LOo5?  nB*0F*G*,?  (SBO0P<t)|  >  FABXLX(X) 

LET  HOPS  «  S.NODE  ♦  GRPS  ♦  PBLIS 
POR  I  *  1  TO  N.NODE,  DO 
PRINT  1  USE  WITH  * 


RECEIVE. PERCENT (NODE)  ,  GROOP(HODX)( 


♦  25) 


BINT  1  LINE  WITH  I*  TRANSMIT. PEFCENtjl) .  RECEIVE, PERCENT (X) . 
l|RpOL^oi»S-  ***0D8»'  GROUP  (X)  ,  (PABlin!)  -  a.  NODE  -  GRPS) .  PARI  LI  (X) 

*«(U|  «•{*•) 


«« , 


LOOP 

SKIP  1  OUTPUT  LINN 
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HEAD  UP. DATS. PERIOD 
BEAD  PROCESSING. TIHX 
REAS  PKT. XBN.TIBE 
READ  TINE. LIBIT 
READ  AVE. NEW. TRAFFIC. INTERVAL 
READ  WINDOW 
■  ■ 

•tt  IN. GROUP  BEANS  THE  PERCENTAGE  OP  GENERATED  TRAFFIC  THAT  HILL  NOT 
•tt  LEAVE  ITS  BASIC  GROUP.  SINXLABLX  FOR  XN.PANXLX. 

•«  PBNT  IS  AN  INTEGER  WHICH  CONTROLS  THE  LEVEL  OP  DIAGNOSTIC  PRXNTXIO. 
•tt  0  ->  INPUT  DATA  ♦  RESULTS 

•tt  1  ->  0  ♦  TRACES  ALL  PACKETS  ♦  LISTS  INITIAL  NEIGHBORS  ♦  LIST 

•tt  BEST  PATHS  H/  CV  AT  END  OP  RUN 

•tt  2  ->  1  ♦  ANNOUNCES  CHANGES  IN  REST  PATHS 

•tt  3  ->  2  ♦  TRACES  ALL  UPDATES  ♦  ANNOUNCES  ALL  NEH  BEST  PATHS 

•tt 

•tt  SHP. LINKS  IS  THE  NUNBER  P*  LINKS  TO  BE  SABPLEO 

•tt  NO. OP. SABPLBS  IS  THE  EXPONENTIAL  BEAN  NUMBER  OP  SAMPLES  TO  BE  TAKEN 
•tt  AT  EACH  OP  SBP. LINKS  LINKS  IN  THE  LAST  HALF  OP  TEST. 

J tt  LINKS  IS  THE  TOTAL  NUMBER  OF  LINKS  IN  THE  NETHOBK. 

READ  IN. GROUP*  XN.FABXLX 
READ  PRNT 

READ  SMP. LINKS*  NO.OP. SAMPLES 
READ  LINKS 

•  i 

PRINT  8  LINES  WITH  OP. DATE. PERIOD,  PROCESSING. TIME,  PKT.XMN.THIB* 

TIME. LX HIT,  TRAP. LIBIT ,  AVB. NEH. TRAFFIC, INTERVAL*  HIM BOH, 

PKT. MIN.  PKT. BAX,  IN. GROUP,  IN.PAMILT  AS  POLLOHS 
UPDATE  PERIOD  IS  **.*»**■•  SEC 

PROCESSING  TIME  IN  EACH  NODE  FOR  ANT  PACKET  IS  .•••••*  SEC 
PACKET  TRANSIT  TIME  BETWEEN  ANX  T«0  NODES  IS  .***•••  SBC 
TEST  DURATION  IS  ««••. •'**«**  SEC.  TEST  LIMITED  TO  **>•*•  TRAFFIC  SESSIONS. 
NEW  TRAP PIC  SESSIONS  ARE  STARTED  AT  AN  AVERAGE  INTERVAL  OF  *•.♦*•»**  SEC 
CHANNEL  VALUE  CALCULATION  WINDOW  IS  ***,•**••*  SBC 
EACH  TRAFFIC  SESSION  VARIES  FROM  TO  «*  PACKETS 
AT  LEAST/"*.  %  OP  TRAFFIC  IS  INNER  3BO0P,  ANOTHER  *•.  ( 

^SKIP  1  OUTPUT  LINE 

••tt  S3B  CHAPTER  $  FOR  DESCRIPTION  OF  A8BAXS 


IS  INNER  PAMXLX. 


RESERVE  LINK. ABLE ( 
RESERVE  LNK. HONITO 


„*}  AS  LINKS  RX  6 
*?*#•»?>  .AS  N. NODE  BX  N.MGOE  RX  3 


_ _ _  _  .  _ LIMIT  /  AVE. NEW. TRAFFIC. INTERVAL) 

RESSRVB  TRlCERf*',"i  AS  EST.MAX.OP.SbAFFIC  BI  2 
RESERVE  SBP.SETfMl  AS  SBP.LINKS  81  2 
RESERVE  QO.DISTB(*i  AS  250 

PRINT  1  LINE  AS  FOLLOiS 

,  ,  «« 

POR  r  *  1  TO  LINKS.  DO 

<tFOR  J  •  1  TO  2,  &!A0  LINK. ABLE (I, J) 

PRINT  1  LINE  HIT B  LINK. ABLE (I* 1) ,  LINK. ABLE (1*2)  AS  FOLLOWS 
•  »  *• 

^oof 

• •tttt  SCBEOOLZNG  INITIAL  EVENTS 
••tt 

••ee  SCHEDULE  THE  FIRST  UPDATE  FOR  PACE  NODE  <>!EW.0?DATS.ME5SAGt| 

••tt  P3E53E  ALL  CV»S  FOR  THIS  UPDATE  (CV.tATCH) 

••tt  SCHEDULE  FIRST  PACKET  SESSION 

••ft  SCHEDULE  TEST  FOR  MAI  QUEUES  HALF  WAX  THRU  TEST 

••tt 

FOR  EACH  NODE 

SCHEDULE  A  MEN. UPDATE. MESSAGE  GIVEN  NODS,  UPDATE  IN  (OSIPOUUf 
(0.0*. 1*1})  UNITS 
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SCHEDULE  A  CV. LATCH  AT  0.0Q 
SCHEDULE  A  STOP. SIMULATION  IK  TXHB .LIMIT/4. 
SCHEDULE  A  HEH. PACKET. MESSAGE  GIVES  PACKET 
♦  EXPONENTIAL.? (A VS. NEH. TRAFFIC. I HTEBVALj 
SCHEDULE  A  QU. SAMPLER  IN  (TIME. LIMIT 

- -j  |41 - -  —  - 


RESSBVB  BEST. 


AS  N. NODE  BT 


TGSVAL.  5)1 

'fei  t!1? 


OMITS 

ID  (2  *  .1 
UIISS 


ABLE (1,2) 


I  XU  0*  uu 

lGHBOB.lZST (LINK. ABLE (X,2) ,J,1)  m  0 
NEIGHBOR.  LIST  (LINK.  AEt.S  fl»21  ,  J,  1)  «  LINK.  ABLE  (1,1) 
NEIGHBOR. LIST (LINK. ABLE (X«2| ,J,3)  ■  1 


******  XDEHTXFT  NEIGHBORS ,  SET  INITIAL  CV*S  AID  PRZIX 
* » 

FOR  I  «  1  TO  N. NODE.  DO 
LET  BEST. PATH  (1,1,1)  «  I 
LOOP 

RESERVE  NEIGHBOR. LIST (*,*,•)  AS  N.HODB  BX  6  8*  3 
FOR  1*1  TO  LINKS.  DO 
FOR  J  *  1  TO  6.  DO 

IP  HBIGHBOR. LIST (LINK. ASL£(I,1),J,1)  »  0 

LET  NEIGHBOR. LIST  (LINK. ABLE (1,1) ,J,1)  *  LINK* 

LET  NEIGHBOR. LIST (LINK. ABLE (1,1) #J<.3)  •  1 
LET  H  =  J 
GO  IBXT.SXSP 
ELSE 
LOOP 

•  BEIT. STEP* 

FOR  J  -  1  TO  6.  DO 

IP  NEIGHBOR. LIST(LIl»K.ABLEjXt2L.J/1)  »  0 
LET 
LET 

GO  LLSS.SXEP 
ELSE 
LOOP 

•LAST. STEP* 

LET  NEIGHBOR. LIST (LINK. ABLE fl, 1)  ,H,2)  «  TBS 
LET  NEIGHBOR. LIST (LINK. ABLE (£«2)  ;J,2)  -  IBS 
LOOP 

t  • 

IP  PRNf  >  0 

SKIP  3  OUTPUT  LINES 

PRIST  1  LIKE  AS  FOLLOWS  . 

.RFjm  MVBKfSi**”*5 

PHINt' I^LXNE^RITH  I  AS  FOLLOIS 
NODE  •*  33IGH|OHS^AND  Cf 

?°P5INT  1  LXNE'mIXH  NEIGHBOR. LIST (I, J, 1)  AND  NEIGHBOR  .LIST(I,J,  3) 
AS  FOLLOWS  ^  ■ 

«*  ** 

LOOP 

LOOP 

REGARDLESS 

•  ■  * 

* ***** 

START  SlflULATXGM 
r • ttt* 

SKD  ••OF  NAIM 
• « 

••*«  THIS  ROUTINE  HALTS  THE  PROGRAM  AND  GIfFS  SEVERAL  STATISTICAL 
**tt  REPORTS  ON  THE  STATUS  OP  THE  SIMULATION,  AFTER  POUR  REPORTS 
••«  THE  BOOTHS  STOPS  SHE  SIMULATION. 

, « 

EVENT  STOP. SIMULATION 

DEFINE  TOT. HOPS,  TOT. PACKETS  AND  DELIVERED  AS  VARIABLES 
REPINS  AVE.TXilB  ANO  AVE. NODES.  H0PP5D  AS  REAL  VARIABLES 
DEPINS  RATIO  ANO  IDEAL. TIME  AS  REAL  VARIABLES 
DEFINE  t  AS  A  REAL  VARIABLE 
DEFINE  S0,ia,I2,32SUM  AS  BEIL  VARIABLES 

•  •(*  PEEK  COUNT  IMS  FOUR  REPORTS 

• •«  TOT ,  PACKETS  SOBS  THE 'TOTAL  PUTS  GEKE8ITRD  OP  TO  THIS  POINT 
• ***  DELIVEHED  SUNS  THE  TOTAL  PITS  BEACHING  THEIR  DESTINATION 
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«•«  TOT. HOPS  SUBS  ALL  HOPS  HADE  BT  ALL  PITS 
"tt  SOB  SOBS  SAMPLED  Q  SIZES 
• • tt  X  IS  THE  TOTAL  HUMBER  OP  SAMPLES 
|  •  tt  Z2S0B  IS  SUE  SUM  OP  SAMPLE  SIZES  SQUARED 

LET  P2BK»PBSKM  . 

LET  TOT. PACKETS  «  0 
LET  DELIVERED  ■  0 
LET  TOT.  HOPS  »  0 
LET  SUM  *  0 
LET  X  »  0 
LET  Z2SOM  *  0.0 

JJM  FBIHT  BP  NEIGHBORS  AMD  CT 

IP  PBMT  >  0 
SKIP  3  OUTPUT  LIMES 
POE  I  ■  1  TO  M.BODB.  DO 
SKI?  1  OUTPUT  LIMB 
PRINT  1  LINE  WITH  I  AS  POLLOfS 

BEST  PATHS  PBOH  NODE  •«  TO  —  DESTINATION  -  BP.SEIOHBOB  -  CV  PBM  BP. MOOS 
FOB  J  «  1  TO  H.NODB,  DO 

I?  (GROUP  <11  o  GROUPIJI  AMD  I  NE  J> 

P3IMT  1>  LIME  WITH  J, BEST. PATH .  BEST. PATH (I.J.2)  AS  PQLLOHS 

REGARDLESS 

LOOP 

FOB  J  -  (M.IIODE^U  TO  NGFS.  DO 

IP  (GROUP  (I)  NE  J  AMD  PABILt(I)  ME  J  AID  J  >  M.MODB) 
t?  BEST. PATH  (1,0.11  SB  0 

IP  (PAM. OF. GBP  (Jf  kE  PAMILX (I)  AMD  <1  <«  (N.MOOE  ♦  GBPS)} 

GO  OMXT.PRXMT  - 

ELSE 

PRINT  1  LIME  WITH  J.  BEST. PATH  (X.J.1) ,  BEST. PATH (I.J.2)  AS  POLIOS* 
'OMIT.  PRINT*  **  " 

mam 

.  LOOP 
LOOP 

Regardless  •  ~ 

JJ«  COUNT  PKTS  CHEAT  ED  AMD  DELIfEHSO 

FOR  X  »  1  TO  TOT.  MEW,  TRAFFIC,  DO 

L2T  TOT. PACKETS  -  TOT. PACKETS  *•  TRACES (1*1) 

LET  OEUVBaSD  *  DELIVERED  ♦  T3ACS3  (5,2> 

LOOP  . 

;j*«  PRINT  SELECTED  INPUT  DATA 
BEGIN  REPORT  ON  A  NSW  PASS 


UPDATE  PERIOD  IS  **„«***»»  SEC 

PROCESSING  TIMS  IN  BACH  MODE  POH  ANT  PACKET  IS  ,*»*«»  SBC 

JACKET  TRANSIT  TIMS  BETWEEN  AMI  TWO  NODES  IS  .*•*«**  SEC 

TEST  DURATION  IS  ««F. ******  SEC.  TEST  LIMITED  TO  ***«•  TRAFFIC  SESSIONS. 

NSW  TRAFFIC  SESSIONS  ABE  STARTED  AT  AS  AVERAGE  I8TS1VAL  OP  ••.••••I*  $IC 

CHANNEL  VALUE  CALCULATION  WINDOW  IS  #**.****••  Sgc 

“ACK  TBAPF.XC  SESSION  VARIES  FROM/-**  TO  "*  PACKETS 

AT  LEAST  **.  1  or  TRAFFIC  IS  INNER  GROUP,  ANOTHER  •*.  t  IS  INNER  PAAILT. 


PRINT  PRt  STATISTICS 

SKIP  1  OUTPUT  LINE 
PRINT  2  LINES  NS  FOLLOWS  ' 

HOOKS  NO.  MEAN  TI8E 

HOPPED  PKTS  PEH  PKT 

*'D£rI33.:cI8.i2*2;SJSIfc4,  °3« , 


PEAK  TIN* 
TIME 


IDEAL 

TINS 
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_  ♦  ri  *  hop.couh?(I, packet)) 

ATA (1*1)  /  BEAL. FjHOP. COUNT (I.PACKET) ) 
. XKN. TIME  ♦  (1-1) "PROCESSING. TIBS 
OP. COUNT (I, PICKET}.  AVE.XIBE,  CLOCK. DA 


«.***•** 


DATA  (1,2) 

*,****•• 


LET  TOT. HOPS  *  TOT. HOPS 
LET  AVE.TIHE  *  CLOCK. DATA { 

LET  IDEAL. TISE  a  I*PKT 
PRINT  1  LINE  WITH  I.  HOP 
IDEAL. TIHE  AS  FOLLOWS 
•a  **•  «.  *«*«*« 

REGARDLESS 
LOOP 
•  « 

• ' <C  PRINT  ALEBT  HSS  I?  A  PST  BOPPED  HOSE  TEAS  TOTAL  NUHBES  Of  NODES 
• ■ 

I?  SSS.HLT  NB  0 

SKIP  2  OUTPUT  LINES 
PBINT  1  LINE  AS  FOLLOWS 

»«»  NOTE  AT  LEAST  1  PACKET  SOPPED  HOSE  THAN  THE  TOTAL  StlHBEB  Of  NODES 
SKIP  2  OUTPUT  LINES 
PISaSDLESS 

LET  ATS. NODES. HOPPED  *  BEAL. ? (TOT. HOPS)  /  BEAL. f (DELIVERED) 

j;<*  prist  selected  statistical  data 

SKIP  3  OUTPUT  LISES 

PRINT  1  LINS  WITH  ATE.  NODES.  HOPPED  AS  FOLLOWS 
SIAN  NUHflEB  0?  NODES  HOPPED  PER  PACKET  IS  **.* 

SKIP  1  OUTPUT  USB 

PFIHT  1  LINE  WITH  TOT. NEW.TR APPIC  AND  TOT. PACKETS  AS  FOLLOWS 
A  TOTAL  OP  «*  HEW  XSNS  WEBB  STARTED  (TOTALING  •**•*  PACKETS  ). 

Pr.INT  1  LINE  WITH  (TOT.  PACKETS  -  DELIVERED)  AS  FOLLOWS 

0?  THESE,  **«  PACKETS  WERE  UNDELIVERED  WHEN  THE  TEST  WAS  ENDED. 

SKIP  t  OUTPUT  LISE 

IZT.  R&TSO  *  HEAL. FJNET.  D.  LINKS)  /REAL. P(UP. STARTS) 

PBINT  I  LIRE  WITH  ^ATIO  AS  FOLLOWS 

FOR  BACH  NSW  UPDATE,  AS  AVERAGE  OP  •*«.•  LINKS  WERE  USED. 

SKIP  1  OUTPUT  LINE 

P-INT  1  LINE  WITH  HAT. 0. HOPS  AS  FOtLOUS 
LONGEST  BEST  PATH  AT  AST  TIHE  WAS  **•  LISKS. 

»'t<  SKIP  TO  END  Of  ROOTISB  If  STILL  IN  FIRST  HALF  Of  TEST 

« i 

IF  PEEK  <3 
GO  CON.TISOS 
USE 

||«  PRIST  THE  aUHEES  OP  LINKS  SAHPLED  AND  TOTAL  SAHPLS3  PEN  UNK _ 

SKIP  1  OUTPUT  LINK 
PFINT  3  LIMIT 


:nt 

CC20B 


FOLLOWS 

58: 


3  LINES  WITH  SUP. LINKS,  3HP.CS5H  AS  FOLLOWS 

-  L^i%il«ir 

***  SAHPLSS  /  LINK  SERB  TAKEN 
END  "OF  3ACKS008D  DATA 

PRIST  SAX  Q  LENGTH 

I?  PENT  >*  0 

SKIP  2  OUTPUT  USES 
PRINT  2  IXHSS  A." 

K1KIHUH  ausafe  LE£ 

PROS  TO  SAX 

"  1  TO  KIRKS*  DO 

»  LINK. ABLE  (I,? 

....  ...  *  LINK. ABLE (1,2 
PRIST  1  LXSS  WITH 
»*  m* f  **« 

PRIST  I^INE^ISD 
LOOP 

RSGABDUSS 

V  0 

"«  PRIST  THE  SAHPLIKg 
"AN  SUBS  10  CALCULATE 


A.S.LSK.  SQSIT08 (A, 5,3) 
S,A,L8K.aOHItQa(S,A,3) 


L'S  FOLLOWS 
AS  FOLLOWS 


COUNT  OF  C 

AVSSAGS  ii 


sizes  fsoh  o  t8#a  250, 

0  STANDARD  DEVIATION 


AND  COMPOTE 
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« • 

B2GTN  REPORT  OM  X  HEM  PXG1 
P5IHT  1  LIME  XS  FOLLOWS 
Q-StZB  -  SIMPLE  DEHSXTX 
FC3  I  *  1  TO  250.  DO 

LET  SOU  *  *QU.  DXSTB  (X)  ♦  SOI 

LET  XaX*GC.DI5TR (I) 

LET  Z2*  Q0.DISTB(S{*({I-1|**2) 

LET  Z2S0S*  22S0B*  Z2 
If  QO.DISTRfl)  FB  0 

PRINT  1  LINE  NISH  (1*1)  BED  QO.DXSTBdt  XS  FOLLOIS 

**•  ***  . 

HXGXBDLESS 

LOOP 

12"  t  «  son/* 

PrINT  1  LINE  NISH  I  XS  POLLOBS 
ATEBXGB  Q  LEMOSH  -  ••*.*** 

LIT  XB  ■  X 

r^P^-o^MT^iSI3118- 

PUNT  1  LINE  WITH  SD  XS  FOLLOWS 
STXMD1B0  DETXXTXOI  * 

"C«  CHECK  XLL  QMOELXTEBSO  PETS.  BBPOST  XI!  NISH  X  HOP  COQlt  >  R.SOD1 
1 1 

PRINT  1  LINE  IS  FOLLOWS 

c::gsuxL.0ELxts_Foa  pxckets_not  oelxtbbed  oescbided  below 

PICKET,  90 

_  _  ..  .  _ _ _  _ HOPPED  (MESSAGE* 

XS  FOLLOWS  _  7  * 

PACKET  RELEXSEO  6«  •**.••**0*  XMO  BXS  ***  HOPS 
REGXBDLESS 
LOOP 

IF  PEEK  IK 

hi  a  co,,•tXM, 

\\U  NESCHBOOtZ  THE  NEXT  StOP.SXatttkTXaR  ^ 

scasoats  x  stop.sinaLXTioi  it  tihe.lxhit/*.  brits 

£S3^'*0P  SSOP.SXaOLXSXOl 
HIT01R 
BSD 
»» 

4  « 

•*cc  this  ROOT IRE  XS  CXLLEQ  WHEN  X  RODE  OSXGXRXTES  XN  ttPDXTBjSSSSXOBu 
[‘it  THE  XRXTIIL  O-USO  IS  SENT  TO  XLL  OF  THE  IRITXXTXEG  NODE'S  HEXQUEORS 

•V2NT  NEU.OPDXtB. MESSAGE  GIVER  SERDXHO.RODE  XRO  TXPS.HESS101 
LIT  OP. STARTS  -  UP. STARTS  *  1 
t  TOR  X  *  1  TO  LINKS,  DO 

JJrt  CHECK  EACH  LXtt  ¥0  SEE  IF  SERDXSG.IODE  IS  OR  ORE  8*0 


I.n  »  SBRDXSG.MQDB  01  LZBK.A&E  (X,2)  •  SEW) ISO, RODE) 


If  ILIMK.X 

CREATE  *  ns. . - 

lII  8SLxilapilslkCS)',S0sinDtSG.H00i 

IF  LXHK.ABLS<I,W  *  SENDING.  RODE 
’  |*R  If  OPPOSITE  RODE  XS  IS  XROTnEB  FiHILX? 

RE  rxuiLt 


If  FXBILf  (LXRK.A 


let  nn,  lt  jn 
LET  DESTi.»XTI 
00  LIES. NEXT. STOP 


RK.xaLSit,2)l  re  r 
jaESSAGEI  *  FXaitf 
TI0R(!1ESSXGE)  «  Fk 


IBXLI  (SENOXRO* 


.ROD!) 

iooij 


wa 
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2LSS 

•  • 

‘  >tt  IP  OPPOSITE  HODS  ZS  IS  A BOTHER  GROOP  (Si ME  PAMILI)  : 

ZP  GROUP  (LI MX.  ABLE  (1,2) }  ME  GROOP  (SENDING.  MODE) 
LET  GRP  (MESSAGE)  ■  GROUP  (SENDING-. NODE) 

LET  DESTINATION  (MESSAGE)  «  GEOOP  (SENDING. SODE) 
GO  LIST. NEXT. STOP 
ELSE 

•  t 

•  •*<  IP  OPPOSITE  HODS  IS  IN  SAME  BASIC  GHOOP 

•  • 

LET  DESTINATION  (MESSAGE)  *  LINKABLE  (1,1) 

•  LIST. SEXTa STOP* 

LET  NEXT. STOP  (MESSAGE)  =»  LINK.  ABLE(I,2) 

ELSE 

IP  PAHILT  (LINK. ABLE (I , 1) I  NE  PAMILI  (SENDING. NODE) 
l.ir  (MESSAGE)  «  FAMILY  (SENDING. NODE) 

_ JTI8ATION  (MESSAGE)  »  BASIL*  (SENDING. NODS) 

GO  INCL. NEXT. STOP 


LET  PAM.  _  _ t 

LET  DESTINATION  (MESSAGE) 

.?n  rvr'r  u.r.  waii 


ELSE 

IP  GROUP  (LINK. ABLS(t,  1))  NS  GROOP  (SENDING. MODE) 

LET  GRP  (MESSAGE)  *  GROUP  (SENDING. NODE) 

LET  DESTINATION  (MESSAGE)  •  GROUP  (SENDING. NODE) 

GO  INCL. NEXT. STOP 
ELSE 

LET  DESTINATION (MESSAGE)  •  LINK. ABLE (1,2) 

•XKCL.S2Xt.STQP' 

LET  NEXT. STOP  (MESSAGE)  *  LINK.  ABLE  (1,1) 

'  '  3 EG A BOLES S 

°  JM  SCHEDULE  ARRIVAL  OP  0-SSG  AT  OPPOSITE  SOON 

SCHEDULE  AN  ARRIVAL. MESSAGE  GIVEN  MESSAGE  IN 
U.XMN.riMS  UNITS 
,  PS3ABDMS3 
,tLOOP 

f  J<e  5CH3D0LS  TRE  NEXT  OSSGINATION  OP  A  U-MSG  PQH  THIS  MODE 

sesmis  A  MEN. UPDATE. MESSAGE  GIVEN  SENDING. NODS  AND  UPDATE  AT  «• 
(v  STFOBM. P (EARLIEST. UPDATS,  LATEST. UPDATE,  3)) 

PEtsVS 

2ND  »*0?  MSB. UPDATE 

‘  '  — 

!«  :S.S. RgaH5Bj.CSEATK_CONrtNU5D^-*f(3-SS„ REPRESENTING  *N2  NJBUttNS 


J*C  ;?  A  U-MSG  PROM  A  SOOB  APTSR 


UPDATE 


even:  tint,  update.,' iessaos  given  last. mode,  next. NODS,  set.CV,  ' 

3c33;r.  PA.WLY,  SOP-CST  AND  G8.D0P 
CSX  All-  A  MESSAGE 

ilz  § II a i Hi^aEsilo S) ^S^lIIt. mode 

Lit  NEXT. STOP (MESSAGE)  -  NEXT* NODS 
DBSTI NATION JS SSSAoE).  -  SOURCE 


LS:  CHANNEL. VALUE (MESSAGE) 
L»T  GRP  (MESSAGE)  *  G8.0UP 
;*r  ? AM. tt  (MESSAGE)  -  PA. 
LSI  NODSS.HOPPEO(3SSSAGS) 


*  MET.CV 

ri'PAlMLI 

AfiPi  m  R 


t li.  RSLATSD  0*N5G  55  SCHEDULED  TO  A8SIVS  AS  SHE  NEXT  DESTINATION 
AFTER  A  SELECTED  TRANSMISSION  TIME 


_ _  *  aop.  err 

*  •« 

'  u t* 

» » 

SC'TFILE  AN  ARRIVAL. MESSAGE  GIVEN  MESSAGE  IN 
3.SS.S.TIMK  OMITS 
fj  5  £ 

SHi>  •'•CP  COMt* UPDATE 
•  1 

»  I 

"*t  -SIS  300TIME  PROCESSES  AM  UPDATE  MESSAGE  AS  IT  A&RIV25  IN  A  NOON, 
•'«  2SLASX5G  IT  TO  NEXGDSOSS  IP  APPROPRIATE 
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EVEN?  ARRIVAL. MESSAGE  GIVER  ZD . MESSAGE. RUBS IB 
LET  22S51GE  *  ID.  MESSAGE.  HDtlBER 
LET  THIS. RODE  *  HEXT. STOP  (MESSAGE) 

LET  5EZ.J.LISKS  *  MET. U. LINKS  ♦  V 

LET  MODES. HOPPED (HESS AGE)  *  HODES. HOPPED (MESSAGE  ♦  1 
•*«  ID  C*  OP  LAST  RELATING  ROSE 

i  i 

FOB  1*1  TO  6.  DO 

IP  R2IGHB0R. LIST (THIS. RODE.  t,  1)  =  R ELATES (MESSAGE) 

LET  CV. OP. LINK  *  HEIGHBOB. LIST  (THIS. HODS,  I,  3) 

GO  SELECT. BEST.  PATH 
ELSE 
LOOP 

•  SELECT. BEST. PATH* 

LET  TOTAL. CV.OP.PAIH  *  CV .OF. LISE  ♦  CH1NNEL. VALUE (MESSAGE) 

•  'U  ID  BREVIOOSLI  SELECTED  BP  HEIGH BOK 

i  « 

LET  SP.SEXGSSOR  *  BEST. PATH (THIS. NODE, DESTIHATIQK (MESSAGE)  , 1)  . 

'•«  IP  RELATES  *  CURREHT  BP  NEIGHBOR,  GPDAIE  IIS  CV  TO  THE  DESIIRATIOI 
'•<<  AID  RELAT  UPDATE 

t  t 

IP  REUTER  (MESSAGE)  *  8S* HEIGHBOR 

LET  BEST. PAXB (THIS.  RODE, DESTX3ATI0R  (MESSAGE) ,2)  »  CHAHH2L.VALUE(H2S5A8E) 

I?  PR5T  >«  3  ' 

SKI?  1  OUTPUT  LIRE 

PRIST  1  LIRE  HITH  THIS- RODE,  DESTINATION (MESSAGE) ,  BP. HEIGHBOR, 
CE1SSSL.VALUB(MBSSA6»'>  C’.OP.LIHK,  TOTAL. CV.OP.PAIH,  TIME.? 

as  pillows  '  • 

RODE  **  UPDATES  CV  THRO  SAME  BP  TO  **  (T6SB  **)  AS  **•♦•**•  ***  AT  •*.<***••  SEC 
SKI?  1  OUTPUT  LIRE 
(  f REG1EDLESS 

GO  5SLAT. UPDATE. TO,  HEIGHBOH3 
ELSE 

'  ’it  IP  THEBE  HAS  HO  BP  HEIGHBOR,  ADOPT  BELATSH  AS  BP  HEIGHBOR  AW 

•  •  U  EILAT  UPDATE 

•  i 

IP  Br.SIIGHBOR  »  ROME 

LET  LIST.  PATH  (THIS.  RODE, DESTIHATIOS  (MESSAGES  ,1)  *  RELATES  (MESSAGE) 

LIT  3IST. PATH (THIS. NQDEIdESTINATIOH (MESSAGE) ,3  •  CHAHHEL. VALUE  (MESSAGE) 

ttL2T  3?. NEIGHBOR  *  RELATES (MESSAGE) 

IP  P?MT  >■  3 

SKIP  1  OUTPUT  LIRE 

PRINT  1  LIRE  HITH  THIS. RODE,  DSSSIHAtIQB (MESSAGE)  ,  BP. HEIGHBOR,  TIME.?, 
TCni.CV.OP.PATH  AS  POLLOHS 

SIS  BEST  PATH  PROM  **  TO  •*  HOB  TH88  **  AT  **».****••  SBC.  BEST  SBt'CV* 

SSI?  1  OUTPUT  LIRE 
REGARDLESS 

GO  EILAT. UPDATE. TO. NEIGHBORS 
ELSE 

**«  I?  THE  R SLATER  IS  HOT  THE  BP  MEIGS  BOEr  AMD  IP  THE  REH  PAL  SI  IS_ 

'  >ca  SHORTER  THAN  THE  OLD  BEST  PATE*  MAKE  REUTER  THE  HER  BP  HEIGHBOR 

•  *««  AMD  RELAT  THE  UPDATE 

i  i 

FOR  1*1  TO  6.  DO 
I?  SIIGHBOR.LIST 
CV.T0.3P.H 
GO  COMPARE. CVS 
ELSE 
LOOP 

IFQ^IlS;:PKTH^HI3.HODB,aESTIHATIOH(M25SAaE),2)  *  CV.SO.8P.  HEIGHBOR)  > 


ST  (THIS  .NODE,  I  ( t)  »  BP. NEIGHBOR 
.HEIGHBOR  a  HEIGHI 


(BOB. LIST (I  HIS. HODS, 1,3) 


150 


m2:  doc 


s 


1  NAVwL  POSTGRADUATE  SCHOOL 


LET  OLD. BP  *  BP. NEIGHBOR 

LET  OLD.CT  »  BEST. PATH  (THIS. NODE,  DESTINATION (MESSAGE) r  2) 

LET  LNK.CT  »  CT.TO. 3P. NEIGHBOR 

LET  3EST. PATH (THIS. NODE,  DESTINATION (HESS AGE) ,  1)  *  RELATES (BESS&Ci) 
•  “  "«»“  »«•»'  '  2)  *  CHANNEL, VALUB 


LET  BEST. PATH (THIS. NODE,  DESTINATION (MESSAGE  ,  1)  *  RELATES (MESSAGA) 

LET  BEST. PATH (THIS. NODE,  DESTINATION (MESSAGE) ,  2)  -  CHANNKL.VALUB 
(MESSAGE) 

f f LET  3P. NEIGHBOR  *  3 SLAT ER (HESSAG2) 

IP  PENT  >«  2 
SKIP  1  OOTPOT  LINE 

PRINT  1  LINE  WITH  THIS. NODE,  DESTINATION (MESSAGE) ,  BP. NEIGHBOR.  TIME.?, 
CHANNEL. PALOS (MESSAGE)  ,  CT. OP. LINK,  TOTAL. CV. OF. PATH  AS  FOLLOWS 
NEB  BEST  PATH  FROM  **  TO  **  NOB  THoO  **  AT  •*.***»•*  SEC.  CV*  ***♦«**• 
PRINT  1  LINE  BZTH  OLD. BP,  OLD.CT,  INK.CV,  (OLD.CT  ♦  LNK.CT)  AS  FOLLOWS 
OLD  BP  THRO  ■*  HAD  CT  OP  ***  ♦  **•  »  ••• 

SKIP  1  OOTPOT  LINE 
REGARDLESS 

GO  R2LAT.OPD1TS.TO.  NEIGHBORS 
ELSE 

"  I?  SBB  PATH  IS  NOT  BETTER  THAN  THE  OLD  BEST  PATH,  DISCONTINUE  0-8SG 

•  t 

|(GO  DISCONTINUE. ORIGIN AL. MESSAGE 

••ft  IP  A  NEB  BP  IS  SELECTED  OR  AH  OLD  3P  IS  OPDAIED.  PBEPARE  INFORMATION 
J|M  POR  THE  NEXT  0-MSG  TO  ALL  NEIGHBORS 

• SZLAT .OPDATE. TO. NEIGHBORS' 

PCS  I  *  1  TO  6.  DO 

IP  NEIGHBOR. LIST  (THIS. NODE,  I  .  1)  »  BP. NEIGHBOR 

LET  CT.  TO.  BP.  NEIGHBOR  -  'NEIGHBOR, LIST  (THIS, MODE,  I,  3) 

GO  COMPOTE. NBT.C? 

ELSE 

LOOP 

•COMPOTE.  NET. CP* 

LET_NET.CP.PPOM.THIS. NODE  ■  BEST. P AT B  (IUIS.80D3,  DESTINATION (MESSAGE) ,2) 

♦  vT.TO. DP. NEIGHBOR 
•OE  I  ■  t  TO  6.  DO 

.  I?  NEIGHBOR. LIST  (THIS, NODE.  S.  2)  »  TES 

\\te  IP  UPSTREAM  NODE  IS  IS  ANOTHER  FAULT  AND  SHIS  IS  A  XMTBA-PAMXLT 
ff-HSG,  RELAX  XT 

IP  (PAH.LT(MESSAGS)  '  NS  0  AND  FAfllLI (09ST3EAS.NODEJ  HE  PAM. LX (MESSAGE) ) 
GO  BET3ANS, UPSTREAM 
BISS 


••ft  IP  0PST8EAM  NODS  IS  IN  ANOTHER  GROUP  AND  THIS  IS  A  IBTRA “GROUP  (SASB 
JJ*«  PA3ILT)  U-MSG,  RELAX  IT 

IP  (3BP (MESSAGE)  N3  0  AMD  GROUP (0PSI8EAH. NODE)  NE  GRP (MESSAGE)) 

GO  BEaB ASS*  UPSTsEAii 
,  (  BLSB 

••ft  rr  UPSTREAM  HODS  IS  IN  THE  SAME  BASIC  GROUP  AND  SHIS  IS  A  BASIC  * 
"U  '  G300P  ORIGINATED  O-MSG,  RELAX  ST 

i  * 


If  (TROOP (UPSTREAM. NODS)  a  GROUP  (SBXi 
AND  PAM.  LX  (MESS  AGS)  »  GHP  (MESSAGE)) 

go  betels,  upstream 

ELSE 


.MODE) 


JJA*  IP  NONE  OP  THE  I DOTS,  UPSTREAM  MODE  DOES  NOT  GET  A  0-M5G 
GO  SKIP. PRINT 

*re:?.ans,upsss8Sh* 

Lit  HOPS  *  NODES. HOPPED (MESSAGE* 

SCH2D0LS  A  COKT.  UPDATE. MESSAGE  felTES  THIS. NODE,  UPSTREAM* NODE, 
SET.CV . FROM. THIS. NODE,  DESTINATION (HSSSAGSL  FAH.LX (MESSAGE) ,  HOPS, 
AMD  GBP (CESS AG3)  18  (PHOCESSING. SIMS  *  UP.MC. RATIO)  UNITS 


files  ooc 


s 
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*  skip,  pant* 

REGARDLESS 

REGARDLESS 

LOOP 

'•M  IS  THE  SIMULATION,  ILL  0-HSGS  ARB  DESTROYED  APTER  TRAVELLING  0N8 
•»«  LINK.  HOWEVER  tSe  UPDATE  CYCLE  PROCEEDS  ACCORDING  TO  THE  B1SIC 
«*<«  CONCEPT  BECAUSE  THE  ARRIVING  tt-KSG  CAUSES  NEW  U-BSGS  10  3E 
"«  INITIATED  IP  A  NEW  BP  HAS  SELECTED  OH  AH  OLD  BP  HAS  UPDATED. 

• »«  I?  A  HODS  COULD  HOT  OSS  AH  INCOMING  U-MSG,  IT  IS  DESTROYED 
<  «2C  HITHOOT  GEHESATI UG  AKY  HEW  U-HSG5. 

«  I 


•  DISCONTINUE. ORIGINAL.  MESSAGE*  M 
IF  HOSES. BOPPED  (BESS AGE)  >  HAX.fi. HOPS 
LET  SAX. U. HOPS  *>  NODES.  BOPPED  (HESS AGl 


LET  SAX. U. HOPS  *>  NODES.  BOPPED  (BESS  AGE) 

REGARDLESS 

DESTROY  BBSSAGE  CALLED  ID.  BESS  AGE.  HD  BUI 
RETURN 

END  "OP  ARRIVAL. UPDA2S 

t  • 

THIS  ROUTINE  CALCULATES  CHANNEL  HALOES  BASED  08  I  TIHK-JJ81G8TED 
••<r«  AVERAGE  OF  QUEUE  SIZES  OVER  A  SPSCIPIBD  TIME  CALLED  THE  WINDOW. 
»»WW  QUEUE  SIZE  INFORMATION  OLDER  TSAH  TBS  WINDOW  TIBS  IS  BISCAR&8&. 

If 

v««iif  rv  LATCB 

DEFINE  EDGE.  LAST,  SUM,  LAS. QO.  SPAN,  BID,  AREA,  WEIGHS #  BLOCH 
AND  RE5AIN6sR  AS  BEAL  VARIABLES 

DEFINE  HONE  TO  MEAN  0  _ _ 

FOR  THIS. H008  »  t  TO  3. HODS,  00 


FOR  IBIS. HOOK  »  t  TO  3. HODS,  00 

'•«  DESTROY  QUEUE  INFORMATION  BETOND  WINDOW  SIZE.  •PACK"'  IS  A  1 
J|<B  OP  INFORM ATIOH  DESCRIBED  LATER. 

FOE  EAC3  PACK  IN  TXPB. QUEUE  (THXS.JfODS)  WITH  ENTRY. TIDE (PACK}  < 

PACKM?BO^TIME.QOEOB  (THIS.  NODE) 

DESTROY  PACE 
•  LOOP 

•  •**  CALCULATE  THE  CV  TO  EACH  1 5108301 

i « 

FOR  3  *  1  TO  C»  DO 

IF  NEIGHBOR  .USX  (THIS. NODE,  J.  2)  *  SE3 
(|  LSI  NEX8  »  NEIGHBOR. LIST  (THiS.iODE, J,  1) 

LET  EDGE  *  0.0 
LET  LAST  *  TXBS.V 
LST  SUM  «  0.0.  . 

LET  LAS. 00  •  0.0 

fol  Hc3  PACK  IS8TI3S.0QB0*  (THIS.  HOSE)  WITH  PAC.HgI0a30E  (PACK* 


•PACK*1  IS  A  PACKAGE 


RElJB,  DC 
LET  AST. PACKS  »  YES 
LET  53*1  *  LAST  i  Sttttr.ttMK  (PACKJ 
Sr3  *  SPAH/2.  *  EDO  2- 

iw  aIea  »  I|Ai;p(NOMasi(PACK))  *  SDAN* 

LET  BLOCK  -  „„  - 

LET  SUE  *  SOM  *•  SLOCK 

L5S  S338  *  EDGE  *  SPAN 

LEI  LASS  *  ENTRY. TIN s7p ICKI 

iix  U3.UCI  S  3EAL.P(SomIsI'(PACK)> 


LSI  £338  -  EDGE* 
m  list  *  ENTRY. t 
LET  us.uo  “  seal. 
LOOP 


?.SG*aOLYSS 
1ST  SSSAIND 
LET  HID  *  ( 


(  *  tsi 


,.P(ROMMSW(PACK)| 

MONITOR  (THIS. MODE,  Slid,  2) 


-  edge 
»  *  edcb 

AIHftER- 


S.ST  cv. op. link  »  isi.riSoa/wiNoow  ♦  i.) 


Sla/*. 

*  I?  EM 
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LET  NEIGBB08.LIST  (THIS. BODE#  3)  *  CT.Ci-.HIf 

REGARD! E55 
LOOP 
LOOP 

"«  SCHEDULE  THE  NEXT  CV  CALCULATION  FOR  ILL  NEIGHBORS.  XX  T88 
• •«  SIHULATION.  THIS  PROCESS  XS  ST NCHRONIZED  FOB  BVERI  NODE  XX 
|'M  THE  NETHORK  (SEE  CHAP  VI}  . 

SCHEDULE  A  CV . LATCH  IN  (2*UP.D ATE. PERIOD)  OBITS 

•'te  EARLIEST. UPDATE  AND  LATEST.BPDATi!  SAT  the  nexx  interval  do bins 


« '« 
»  9«l! 
• '« 

*  *c« 

•  •» 
* '  tit 
*  <M 

f  » 

LET 


WHICH  ALL  NODES  HILL  RAN DON Lt  INITIATE  A3  UPDATE  CXCLS.  THE 
NEXT  CV. LATCH  FOR  AIL  NODES  IN  THE  NETWORK  OCCURS  AT  THE  VERX 
BEGINNING  OF  THIS  INTERVAL.  AFTER  THIS  PERIOD.  THERE  IS  ANOTHE1 
EQUAL  SIZED  PERIOD  DURING  SHXCK  NO  UPDATE  CYCLES  ARB  INITIATED. 
SUT  THIS  PERIOD  INSURES  THAT  ALL  CYCLES  STARTED  DURING  THE 
EARLIEST, UPDATE  TO  LATEST. UPDATE  PERIOD  BILL  BE  COHPtSTED. 

DURING  THESE  XUO  PERIODS#  THE  CV  FOR  ALL  LINKS  ARE  FROZEN «. 


EARLIEST. UPDATE  *  TIHE.T  ♦  (2*  UP. DATE. PERIOD) 

LET  LATEST. UPDATE  •  TIRE.V  ♦  (3*  DP. DATE. PERIOD) 

?,§TUR» 

END  “OP  CV .  LATCH 
« • 

*  « 

"tt  THIS  ROOT! HE  GENERATES  A  TRAFPIC  SESSION  HADE  UP  OP  A 
•'tt  NU80E8  OF  PKTS  (8STB2BN  PRESCRIBED  LIHITS). 

o u  rnt  n  r  swavt  »btt?  no  ciurtotm  rw  ah 


_  _  RABDOH 

PUTS  ARE  SENT  OUT 


VLB 


J|ies!  ON  IDLE  LINKS  It  AVAILABLE#  OS  STORED  IN  QUEUES  IP  LINKS  ARE  BUST. 
EVENT  NEK. PACKET. HESS&GE  GIVES  T. MESSAGE 

DEFINE  CK.XHTB,  CK.RCVR,  X. TOT. PERCENT  AND  R.TQT.PBRCEXT  AS  R2AL 

LSTRX?T&T?P5RC«NT  -  0 

|I?  cKlxHTRS2caSxpoaa.P(0.o,  trns.pcxt,  2) 

SELECTOR  IS  USED  IF  A  PERCENTAGE  OP  fit  TRAPPXC  XS  REQOX1EO 
TO  BE  IH»Ea-GROUP/PAHXLr 

LET  SELECTOR  *»  UBXF0R!1,P(0,Q#  100.#  3) 

*  # 

**a*  rnscx  ras  mssamiMG  mod*  — -• 

* » 

*0$  I  »  1  TO  ft*  NOOK,  OO 

LET  X.TOT.P^HCSNt'a  X, TOT. PERCENT  ♦  TaASSaiT.£2RCB»T(I) 

IP  CK,mX3  <«  X.SQT.SBRCaii* 

1ST  XRTJI  *  “ 

GO  FIND. RE 
ELSE 
LOO? 

$  * 

jj  tt  sstsct  tw  ascmsi 

L f |HCK?Ic VR75auaiFQSl. P <0.0,  aCV.PCM,  If 
FOR  0  *  1  TO  S.H0DB#  00 

LET  8.  TOT.  PERCENT "  R, TOT, PERCENT  ♦  8  EC  31  VS.  PERCENT  1*3) 

IP  CK.RCYF  <*  H. TOT,  PERCENT 
LET  SCVS  *  J 

GO  CS, GROUPS. ABO.  PAS* LIES 
ELSE 
LOOP 

"it  IF  THE  RECEIVES  BUST  EE  JXMR-GROflP  OX  VASILI,  KEEP  LOOSING  OBfXL 

|| tt  an  adequate  accExvfia  rs  pound 

* CX. GROUPS, AND*  VAST LISS* 

2?  SSLISrOR  <  IP. GROUP 

—  GNOOPIBCVBS 
a  fiCvl 


k 


153 


FILES  DOC 


NATAL  POSTGRADUATE  SCHOOL 


ELSE 

LHT  a.TOT.PSaCENT  •  0.0 
60  FXND.B2CEIVEB 

ELSE 

IF  SELECTOR  <  (XK.GBOOP  «•  IN.  F  A  NIL!) 

IP  FAHILI (XNTBl  »  PANILItRCfB) 

GO  SEE.Zr.X»TR.EQ.aC?a 
ELSE 

LEI  R. TOT. PERCENT  »  0.0 
GO  FZND.BECSXVE1 

ELSE 

'SEE.IP.ZSTR.EQ.BCfB* 

IF  RCVR  «  XBTR  __ 

LET  a. TOT. PERCENT  •  0.0 
CO  FIND. RECEIVER 
*X»SS 

*  DEBITS.  N08B EH* OF. PICKETS* 

LET  PRXlcOIJNT  »  1ST.  F  (UHIFOBH. F  (PICT.  BIN.  PKX.NAK#  *!» 

•  •«  COUNT  TOTAL  TRAFFIC  SESSIONS.  TBS  TRACER  ABBAS  BEEPS  TRACE. OS’ 
• *ec  SESSION  INFORMATION 

ft  - 

LET  TOT. NEB. TRAFFIC  -  TOT. NEB. TRAFFIC  ♦  1  _ 

LET  TRACER  1}  ■  PKT.COUNX 

J'«  CREATE  A  BESSAGE  FCR  EACH  PACIBS 

•OR  I  •  1  TO  PKT.COONT#  00 
CREATE  A_ MESSAGE. 


LET  TIPS 
LET  S2LAI 
LET  FG  -  0 


KB 


sage) p«czaia 


• »e<  ADDRESS  PKT  TO  HODS,  GROOP  OR  I  ANIL*  OF  DESTINATION  AS  imOeaiAMB 


ELSE 


FAB) 


«.W  .  1) 

“  ““  **.  .UHHM.  MM1  —  ”"”y  ^ 


•ADO 


1ST  t 
LET  P 
GO  ADD 
ELSE 

LET  BP.NODB  «  BEST. PATH 


im&k$hhQ*oi*  <a6¥B> 

30. DESTINATION 


LET  PACK.S088ER  (|IeSSAGE|  '  ■  I _ „ 

LET  BEIT. STOP (BESSAGE)  -  BP. NOD* 

; •««  I?  LINK  TO  BP  NEIGHBOR  IS  IDLE, 


(XBTB,  BCVfit*  1) 

NEN.TBAVFXC 


SEND  OUT  PACK EX' 

ill  l&iSJSSmsIferS'fait.;  ”“s,‘ 

<tEL3S 

''<*  IP  LIN*  IS  BOS*.  STORE  PKT  AT  END  OF  QSE02  FOB  THAT  LINKS 
«  • 


*  * 

» •«* 
»»« 


.  ,  I.NaNmRjIBTB.SP.HODS.Z 
LET  LHK.SONITOS (XatR.3P.B0D 
BSGIBDLES3 


IP  LINK  OBESE  CHANCES,  CREATE  A  "PACK**  (A  SACK  AGE  OF  INPORBAKONI^ 
RBICfl  CONTAINS  THE  BEN  Q02GE  SISS  AND  THE  TIES  IS  HAS  OUNCES 
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•  'tt  POE  tar  LASER.  CALC3XATI0B  OE  Cfc 

*  * 

C3*ATE  A  PACK” 

L2T  HONSSB(PiCX)  •  LNK.HOSITOR.  (USB, HE.  IQDE*2E> 

LET  ENI8T.XI32( PACK)  *  TIME*? 

LET  PACoBEISHBOi  (PACK)  »  BP.ttMUfc. 

FILE  PACK  IK  TIHE.Q0E03(rata^. 

BEG  A  8  BLESS. 

•  •  • 

IP  PENT  >*  t 

PRINT  1  LIKE  TXT?  TOT.NEB. TRAFFIC#  I,.  XHTRy  BP.MODE,PG,.  BCVR,  TIBES-N^ 
LNX.NONXTOft (2HT3,  BP. HOOP,  2)  AS  PGLLOBS 
»**»#/••  INITIATED  PRO*  **  I ttSO  *•(••)  SO  *»  IT  •*.*•***•  SEC,  QO*  •»*r' 
SKIP  1  ODIPDI  LI  IS. 

REGARDLESS 

LOOP 

•  t 

••tt  RESCHEDULE  SECT  TRAFFIC  SESSIOF  OP  SO  HAS  SET  Bt  TRAFFIC, LIHXC^ 

•  ■ 

IP  TOT. NEW. TRAFFIC  <  TRAP. LIBIT  _ 

SCHEDULE  A  HKB. PACKET. 3ESSAGE  GITEH  PACKET*  t*“ 

EXPONENTIAL,? (ATS* HER* TRAFFIC. INTERVAL*  1*  OUT*  • 

REGARDLESS 

RETURN 

2ND  "OF  SEU.PACBSir' 

•  • 
t « 

;  *  tt  this  ROOSZHB  PROCESSES  Piers  AS  THEI  ARRIVE  IRA.  MODE& 

EVENT  ISITE.PACKET  GITSI  rD.HOHBMP- 
LET  N2SSAGE  *  10.8(13828 
LET  THIS.  MODE  «  NEXT.  STOP  (SPSS  ACSSi- 
LET  PAST.  NODE  -  RELAXES  (HE3SA«BJ>^ 

IP  PRNt  >«  1  „ 


.2EGA&0L8SS 

J  JNN  IF  THE  PKT  HAS  REACHED  ITS  DESTINATION*  CO  TO  A  PROCESSING  EOOTXttP 
I?  NEXT. STOP (HRSS1G31  «  D BSTIM ATXQNf HESS ACEt 

t  f SCHEDULE  A  COHPLEXSD.taiP  GIVEN  UBSSAGR  NESS*  ^ 

'rp?ll(T  l“ttMS  IS  POLIO**. 

PsoiSStili" 

« • 

••tt  If  put  IS  TO  CONTINUE,  ADDRESS  It  TO  THE  NEXT  BP  NEIGHBOR  BASKO' 

J  ;«*  OH  THE  NODE*  GROUP  Q&  PA  DILI  ID  OF  SHE  DESTINATION  AS  Aitf  ROPRlASCi. 


Ui»E 

LET  S2LATER  (HHSSAGE)  »  THIS.  SOD* 
LET  P.1.GP  (HESSAGE)  *  0 
LET  ?G  •  0 


IF  PASXLt  (THIS.NODEI  HE  PA3ILT  (DESTINATION  (OESSACUf* 
t?T  ?G  *  PAULI  (DESTINATION  (HESSAGEU 
LET  33.QBG  »  fG 
L5T  P3.GP  (HESS AG 8)  *  PC 
GO  ASGN. NEXT. STOP 
ELSE 

IP  3800P  (THIS. NODE)  HE  G500P  (OESXISmON  (HESSAGE)} 
LET  »G  -  GROUP  (DESTINATION  (HESSAS*)) 

LET  5P.08G  *  FG 
LET  Pf!.G?  (HESSAGE)  ■  PC 
#  GO  ASCN.NIXT.SiaP 

.»*«p!*5S*25£«#  ottttiisiM  (HEssAMr* 

*  ASGN.H6IX.3ION* 
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A  NATAL  POSTGRADUATE  SCHOOL- 


LET  NEXT. STOP (NESS AGE)  ■  BEST. PATH  {THIS.  NODE.  BP.OBJ,)) 
t  LET  NODES. HOPPED (HESS AGE)  *  NODES. HOPPED (MESSAGE)  ♦  1 

••**  SCHEDOLE  A  PROCESSING  COBPLETION  TIHE  WHEN  IBS  PKt  HILL  BE  READ! 

••it*  FOB  BETBANSEISS ION. 

•  • 

SCHEDOLE  A  CON. PACKET. SESSAGB  SITES  BESSAGE  IH  PROCZSSING.TIMB  01 ITS 
REGARDLESS 

•  i 

••**  GO  TO  THE  QUEUE  OP  THE  NODE  BHICH  BELATED  THE  ABOTB  PKT.  IP  BHPWr 
••**  DEFINE  THE  LINK  AS. IDLE:  IP  NOT,  PLACE  THE  NEXT  PKT  ON  THE  LINK 
"CC  AND  ADJUST  THE  QUEUE  INFORMATION  BY  CBEATING  A  NEW  PACK. 

•  i 

POP  EACH  MESSAGE  IN  QUEUE (PAST. NODE)  BITS  N EXT. STOP (MESSAGE) “THIS. NOOK, 
PIND  THE  PI ESI  CASE 
IP  NONE 

LET  LNK. MONITOR (  PAST. NODE,  THIS. NODE,  1)  •  ZOLA. 

ELSE 

REMOTE  MESSAGE  PBOM  QUEUE  (PAST. NODE) 

LET  LNR.NONXTOK (PAST. NODE,  THIS. NODE,  2)  • 

LNK. MONITOR (PAST. NODE,  THIS. NODE,  2)  *1 
CHEATS  A  PACK  _ 

LET  NUMBER  (PACK)  -  LNK.  MONITOR  (PAST. NODS,  THIS.MOO*#.  2*. 

LET  ENTRY. TIME (PACK)  »  TIME. T 
LET  PAC. NEIGH  BOR (PACK)  *  THIS. RODS 

- - J0EUB  (PAST. NODE) 

SAGE)  «  0 
SAGS) 


PILE  PACK  IN  TIN' 

IP  NODES. HOPPED JR _ 

LET  BELEASS. TIME  (MESSAGE)  «  TXEE.K 
REGARDLESS 


JJCN  SCHEDULE  THE  ARRSTAL  OP  THE  PKT  JUST  RELEASED  PROM  THE  QUIUHL 
SCHEDULE  AN  ARITE. PACKET  GIVEN  MESSAGE  IN  PKT. XHN. TIMS  UNITS'" 
IP  PR5T  >»  1 


.  ****/' •*  LSAVZ5  •*  THRU  •*  FOR  **  (**)  AT  **.**•#*•  SEC  (PROM  Q)  QU«* 
REGARDLESS 

REGARDLESS 

RETURN 

2ND  "OP  ARITE. PACKET 

t »  — - 

••**  THIS  ROUTINE  CONTINUES  THE  PACKET  ON  IT  BEST  PATH  APSES  PROCESSING 
JJM  IP  THE  LINK  IS  IDLE,  OR  PUCES  IT  IN  A  QUEUE* 

STENT  CON. PACKET. MESSAGE  SITES  XDSNT. MESSAGE. MOURE 
LET  MESSAGE  »  ID! NX. MESSAGE. NUMBER 
LET  THIS. NODE  ■  BELAY E3  ( MESSAGE) 

;j*<  IP  LINK  IS  AVAILABLE,  SEND  OUT  PKT.  LIST  LINK  AS  BUSK* 

It  LNK.aOHITOH  J  THIS. NODE,  NEXT. STOP (MESSAGE) ,  1)  -  IDLE 
SCHEDULE  AN  ABITE. PACKET  GIVEN  MESSAGE  IN  PKT.IMN.tlME  UNITS 
1 1  * 

IT  PRHT  >w  1 

- -  - - - -  —  HUMBER  (MESSAGE)* 

(MESSAGE) * 


(«*) 


REGARDLESS 

•  • 

LET  LNK. MONITOR (THIS. NODE,  NEXT. STOP (MESSAGE) ,  1) 

« » 


*•*—*  SEC.  NO  9 All*. 
BOSK 


%•**  IP  LINK  R AS  BUST.  PLACE  PKT  IN  QUEUE  AND  CREATE  A  PACK  SUH  UK 
j;i«  QUEUE  INFORMATION. 

PILE  MESSAGE  IN  QUEUE (SHIS. NODE) 
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1ST  LHK. MONITOR  (THIS. SODS,  NEXT. STOP (MESSAGE! ,2)  « 

LNK.  MONITOR  (IBIS. NODE.  NEXT. 3T0F  (MESSAGE)  ,  2)  ♦  1 
IP  LNK. MONITOR  (THIS. NODE,  NEXT. STOP (MESS AGE) 7 2)  > 

LNK. MONITOR  (THIS. NODE,  NEXT. STOP  (MESSAGE).  3) 

LET  LNK. MONITOR  (THIS. NODE.  NEXT.STOP  (MESSAGE) ,  3)  • 

LNK.MOHITOB  (THIS. NODE,  NEXT.STOP (MESSAGE) ,  2) 

REGARDLESS 
CSEA‘,,B  A  PACK 

LET  NUMBER  (PACK)  »  INK. MONITOR  (THIS. NODE,  NEXT. STOP  (MESSAGE) ,  2) 
LET  BNTBX. TIME  (PACK)  *  TIME.? 

LET  PAC. NEIGHBOR (PACK)  *  NEXT. STOP (MESSAGE) 
f|PIL2  PACK  IN  TiaS.aOEUB  (THIS. NODE) 

IP  PRNT  >»  1 

PRINT  1  LINE  HITH  TRANS. NUMBER (MESSAGE) ,  PACK. NUMBER (MESSAGE) , 

THIS. NODE,  NBXT.STOP(MESSAGS) .  TIME. V,  LNK. MONITOR (THIS. HODS, 

NEXT.  STOP  (MESSAGE)  ,  2)  AS  FOLLOWS 

*«***/•*  ENTERS  QO  IN  **  POR  **  AT  **.**•**•  SEC.  QU  »  **• 

REGARDLESS 

REGARDLESS 

RETURN 

END  "OP  CON. PACKET 

•  i 
t  * 

"C«  THIS  ROUTINE  COLLECTS  STATISTICAL  DATA  WHEN  A  PKT  REACHES  ITS 

•  '«  DESTINATION. 

•  i 

EVENT  COMPLETED. TRIP  GIVEN  BBS. NON 
DEFINE  DEL. TIME  AS  A  REAL  VARIABLE 
LET  MESSAGE  «  ME5.NUH 

LET  CNTR  *  NODES, BOPPED (MESSAGE)  *  1  - 


TOTAL  NODES  XI  IETB08K. 


*  •«  PRINT  ALERT  IP  NODES  BOPPED  X 

•  • 

IP  (CNTR  >«  N.NODB  AND  MSC.BLI  »  0) 

PRINT  1  LINE  AS  POtLOBS 
PROBLEM  —  MORE  BOPS  TSAI  NODES 
LET  KSG.BLT  «•  1 
REGARDLESS 

'*«  INCREMENT  COUNTER  FOR  TOTAL  NUDES  BOPPED  POR  IBIS  PKT  AND  SOI  NIT 
j;«  TIME  POR  GIVEN  NUMBER  OP  BOPS. 

PACKET)  ♦  1 
DEL. TIME 

MEN  MAX  TO!  SBXS  BOMBER  OP  BOPS. 


NOTE  IP  TBXS  TRANSIT  TIME  IS 

i  « 

IP_  DEL. TIME  CLOCK. DATA  (CNTR , 


L2T~CLOCK.OASA  (CM  Bi "2f 


REGARDLESS 

*•«  INCREMENT  TRACER  AR8AT  HHICB  KEEPS  THE  NUMBER  OP  PITS  GENE RATED 
|J«  AND  THE  NUMBER  REACHING  THEIR  DESTINATION. 

LET  TRACER  (TRANS. MOHBERt MESSAGE) ,  2)"  TRJCXR (T&ANS. NUMBER (MESSAGE)  ,2) *1 

DKSf?OI  MESSAGE  CALLED  MBS. HUM 

RETURN 

END  "OP  COMPLETED. TRIP 
*  * 

♦ •*«  TBXS  ROUTINE  IDENTIFIES  A  SET  OP  THE  BUSIEST  LINKS  OVER  THE  FIRST 
HALF  OF  THS  SIMULATION  SC  THE  LINKS  CAN  BE  SAMPLED  0UEXR4  TBS 
JJ«  SECOND  HALF  OP  TUB  TEST. 

EVES?  QU. SAMPLES 

*  • 

PRIST  1  LINS  AS  FOLLOWS 
— 

•  « 


•SID  POUT 
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S 


A  NAVAL  POSTGRADUATE  SCHOOL 


«  >M  ID  TEE  LAHGEST  QUEUE  SXZB  XI  THE  PXBST  HAL?  Of  THE  SXBOLATIOI. 

«  « 

LET  I  ■  I 

FOR  t  «  1  TO  N.HODE.  DO„ 

FOR  T  »  1  TO  N.HODB,  DO 

IF  HSX  <  LNE. MONITOR  JF.T.31  „ 

LET  (I AX  *  LHK.SOUIIOB  (f,T,3) 

REGABDLES3 

LOO? 

LOOP 

<<M  SHP. LINKS  XS  AH  INPUT  7ABXABLS  LXSTXIG  THE  RUBBER  OP  LINKS  TO  Bt 
• • tt  SA9PLBD  FOR  QUEUE  SX2B. 

•*te  SB?. SET  XS  ANARRAX  OP  HODS  PAXES  FOB  THE  "SHP. LIMBS'*  BUSIEST 
LINKS  OTEB  THE  FIRST  HAL?  0?  THE  SlflULAIION, 

•  • 

*  FILL. SBP. SET* 

FOR  F  «  1  TO  N.HODB,  UO 
FOR  T  «  1  TO  H.HODB,  DO 
IF  LSK.NOUTOR  (FitTS) 

LET  SnP.SST(I,1) 

T 


JT(X,1I 


HAS 


LET  SBP. SET! 

if  I  •  sbp.l _ 

GO  -BEGIN. SABPLXNO 
ELSE 

1ST  I  «*  1*1 
GO  HOP.HEB.flAX 


AND  LMK .BOMXXOB (F  #  X  ,3)  <  BAS 


Ken  . BAX  <  L3K. MONITOR  (P,T»  3)  AH 
LSI  HEH.BAX  •  LNK.ttQBXTQB(F,T,3) 

REGARDLESS 
*  BQP.HB9.aAX* 

LOOP 

LOOP 

LET  HAX  -  HEN. HAS 
GO  FILL. SAP. SET 

*•«  SCHEDULE  PXBST  SAHPLE  0?  ALL  LINKS  XI  SEP. SET 


• BESTS. SAMPLING* 

LET  TI.BSS  -  ^X!^3,LXaXT/j2,,'  8RAL.F(NO.OF.5A8PtBSll 
SCHEDULE  A  SAMPLE  XH  {EXP0SSaTXAL.?{U.M8»  8  )  UMTS 
RETURN 

END  ••  OP  QU* SAMPLES 

•  ttt  THIS  300TXNS  SAMPLES  THE  LINKS  IQSiTXPXEO  IB  QU.SAttPLXB  HUH  AN 
EXPONENTIAL  S43PUNO  BASE. 

EVENT  SAMPLE 

•NN  COUNT  ACTUAL  SAMPLES  TAKEN. 

LET  SEP. CITE  «  saP.CNTl  ♦  1 
•«  INCREMENT  CCUNTSR  BASED  ON  QUEUE  SIS*. 

FOB  t  *  1  TO  sap, LINKS,  DO  . 

LEX  QU.DtSTB  aHR.HORI?OR{Sae.S«fTCX,1LtS8P.SSTiX,2l,  2* ♦tj  • 

gu.flxsia  (LNK.aOH£tOB(SaP.SLS(I,f),SaP,S&T(X4)«  2i*i|  *  1 


$oosl 

•*«  SCHEDULE  taa  NeXT  SAMPLE.  _  . 

TX.NSN  IS  DEFINED  IS  QU. SAMPLE* 

SCHEDULE  A  SAMPLE  XN  <SXPONEMtXAL.?(XX*S2*.8i J  UNITS 

!B°W OP  SAB PUt 

/*  * 

//sxauus 

//*Q  — 

//* 


?0?3iauo20  aD^fSL»SSjf*jHVSOON,U>XT*335Q 
•  DCS- (8ZCPB-FB, U  ECL-1 33, BLKSXXS** 123) 


Q,0XSF«*SHa,03M*S303*.*0»# 


riLZ:  0299 


0 


A  NAVAL  POSTGRADOATB  SCfiOOL 


— >  TYPICAL  INPUT  FILE  <— 


29 

1. 

1. 

t. 

1. 

1. 

1. 

1. 

1. 

1. 

1. 

\: 

i. 

i. 

i. 

i. 

i. 

i. 

i. 

i. 

i. 

i. 

i. 

i. 

\: 

i. 

*.Q( 


1 

1 

1 

1 

1 

2 

1 

1 

1 

1 

1 

1 

1 

2 

1 

2 

1 

2 

t 

1 

1 

1 

1 

1 

1 

2 

2 

1 

1 

ll 

3 

3 

2 

2 

1. 

4 

2 

4 

2 

4 

3 

2 

3 

« 

I 

4 

2 

4 

2 

3 

2 

3 

2 

4 

2 

4 

2 

101 


<-  NUMBER  OP  LINKS 
<-  TRANSMIT  FACTOR} 
8EC2IVS  FACTOR; 
GfiOUP  NUMBER: 
FAMILY  NUMBBi 


<- 

$: 

£ 

<- 

<- 

<- 

<- 

<- 


UPDATE  PERIOD 
PKT  PBC  ‘ 


_  PBOC5SSING  TINE  . 

PKT  TRANSMISSION  TIMS 
TEST  DURATION 
SESSION  INTERVAL 
WINDOW 

%  INNER«6R00Pj  *  INKER  FAMILY 
DIAGNOSTIC  PRINT  LEVEL 

NUMBER  OP  LINKS  TO  SAMPLE;  K UMBER  OP  SAMPLES  SACS 
NUMBER  OP  LINKS 
NODS  PAIES  FOB  SACS  LINA 
« 


IM 

Si 
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OUTPUT  EXAMPLE 


NCOS 

NC. 

1 

2 

3 

4 

5 

6 
7 

a 

9 

10 


12 

13 

14 

15 

16 
17 
IS 

19 

20 


II 


’3 

I 

27 

P 


7RAASNIT 

FACTOR 

1.000 

1.000 

1.000 

1.000 

1.000 

l.CGO 

1.000 

i:8S8 

1.000 

i:888 
1.000 
.  1.000 
1.000 
1.000 
l.CGO 
1.000 
1.000 
1.000 

* 

1:8*8 

i.aao 


\:X  1:888 


RECEIVE 

FACTOR 

1.000 

1.000 

loOOO 

1.000 

1.000 

i.aao 

1.000 

1.000 

l.coa 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

l.oaa 

l.gog 

l.coa 

i:l! 

l.goo 
1.000 
100 


«8IPi» 


11301 

1(301 


FAMILY 
(POM  «( 


2(311 


m 


391 


UPBATB  PERICC  IS  .100099  SEC 


•>ew  TRAFFIC  SESSIONS  ARc 


§SB84°SI( 


.IOC 


START EE  AT  Ah  AVERAGE  INTERVAL  OP 
•3QQQQ0  SEC 
.  TC  21  PACKETS 

GStUP.  ANOTHER  0.  X  IS  INNER  FAMILY 


3-2 :  ii 


o  - 1 1 


23 
23  "  2? 
23  *  24 


{{: 


1!  - 


13  - 
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OUTPUT  EXAMPLE 


NCCS 

NC. 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 


TRANSMIT 

FACTOR 

1.000 

1.000 

l.COO 

1.006 

1.000 

l.COO 

l.ooa 

l.aoo 

l.COO 
1.000 


i*Qqg 


.coo 

.000 

.00 

l.oao 

o 


RECEIVE 

FACTOR 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

l.aoo 

l.ooa 


11 

m 

1 M 

13 

1.000 

l.oao 

14 

.  1.000 

1.000 

15 

1.000 

1.000 

16 

l.aoo 

1.000 

17 

l.COO 

l.oao 

18 

l.aoo 

1.000 

19 

20 

l.aoo 

l.ooa 

1:838 

j.goo 


W  «k 

8  i 


..coo 
1.000 
•  .000 

s:sp 

l.aoo 

A-aao 

l.oao 


[FGR  if) 
1(30 
1(30 
2(31 
2(31) 
2(31) 
1(3(3 
1(30) 

1  111 
2(31 

i!  3o 

1(30 

2(31 

2131) 

3(32) 

3(  32) 

4(33) 

4(33) 

4(33) 

ml 

xml 

4(33 

3(32 

3(32 

mu 


FAMILY. 
(PGM  it 
1(341 
1(341 
1(34) 
1(341 
1(34) 
1(341 
1  34 

ill 

ijiii 

«BI 


‘JFCATE  PERICC  tS  .100000  SEC 

55CCSSSING  TIME  IN  EACH  NCOS  FCR  ANY  PACKET  1$  ,000100  SEC 

'lit  auRATi^N  ts^lo^aodoOo  Sec,TTisTCcprfia*Te0?ioaieffiAFFic 

*i£ W  TRAFPIC  SESSIONS  are  STARTED  at  AN  AVERAGE  INTERVAL  Of* 

n  tc  simff 

AT  least  0.  *  CP  TRAFFIC  IS  INNER  GROUP.  ANOTHER  0.  S  IS  INNER  FAMILY. 


n :  H 


•s 
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UPCATE  PER  ICC  IS  .100500  SEC 

SSgB?sf&U?MasESI?wgiS6«^"Tr»a?5EIs,!(ls8D0?£!re 

TEST  DURATION  IS  500.000000  SEC.  TEST  LIMITED  TO  95000  TRAFFIC  SESSIONS. 
NEW  traffic  sessions  are  started  at  an  AVERAGE  INTERVAL  OF  .100000  SEC 
CHANNEL  VALUE  CALCULATION  WINCCW  IS  .500000  SEC 
EACH  TRAFFIC  SESSION  VARIES  PRCM  1  TC  21  PACKETS 

AT  LEAST  0.  i  CF  TRAFFIC  IS  INNER  GRCUP.  ANOTHER  0.  X  IS  INNER  FAMILY. 


NC. 

PKTS 

3769 

7475 

67*7 

m 

1974 

1155 

ft* 

79 

n 

6 

b 

2 

2 


MEAN  TINE 
PER  PKT 
. 050045 
.148045 
. 267807 
.371600 
• 47323C 
.600169 
.716520 
.835225 
.994289 
1.146388 
1.376437 

1.  §14461 
1.590845 
1.771252 
2.387163 

•  2.272257 
1.901922 
2.303152 

2.  162175 
L 029691 
1.  994116 


PEAK  TIME 
TIME 
.050244 
1.400245 
2.068256 
2.439480 
2.466388 
2.949175 
4.290086 
4.150083 
4.054386 
4.239901 

l:im 

5.253336 

3.439857 

6.051393 

3.954242 

3,539663 

3.253066 

hmm 

2.502305 


IDEAL 

TIME 

.053000 

.100100 

.150200 

.200300 

.250400 

.300500 

.350600- 

.400700 

.450800 

.500900 

.551000 

.601100 

.651200 

.701300 

.751400 

.801500 

:MtiK 

r.M 

1.252399 


MEAN  NUMBER  CF  NODES  NCPPEO  PER  PACKET  IS 
4936 


4.6 


A  TOTAL  OF 
CF  THESE, 


S6  NSW  XHNS  MERE 

73  packets  mere 


STARTED  (TOTALING  S3&64  PACKETS  I. 
UNDELIVERED  WHEN  THE  TEST  WAS  ENDED. 


B0S  EACH  NEW  CROATS,  AN  AVERAGE  CF  23.1  UNKS  WERE  USEC. 
CONGEST  BEST  PATH  AT  ANY  TIME  WAS  U  LINKS. 

CU6US  LENGTH  DISTRIBUTION 

.iV-USiaH  ««. 


0-SJJ5  -  DENSITY 


19  8 

AVERAGE  (J  leagsh 


.439 


STfWARO  CEVIATt£3N  «  2.044t 

UNUSUAL  DELAYS  Pttt  PACKETS  NOT  OEUVEPEO  CESCAIEEO  BELOW 
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